Patents Assigned to Shanghai Bilibili Technology Co., Ltd.
  • Patent number: 11495264
    Abstract: Embodiments of the present disclosure describes techniques for clipping a video. The disclosed techniques comprise obtaining a video including a plurality of frames performing object detection on each frame; identifying objects contained in each frame, wherein a region where each object is located is selected through a detection box; classifying and recognizing the objects identified in each frame using a pre-trained classification model; selecting human body region images; determining a similarity between each human body region image selected from the plurality of frames and a target character image; in response to determining that a similarity between a human body region image and the target character image is greater than a predetermined threshold, identifying the human body region image as a clipping image; and synthesizing clipping images identified in the plurality of frames in order of time to obtain a clipping video.
    Type: Grant
    Filed: October 26, 2020
    Date of Patent: November 8, 2022
    Assignee: Shanghai Bilibili Technology Co., Ltd.
    Inventors: Heming Cai, Long Qian
  • Patent number: 11490173
    Abstract: A method includes: sending, upon receipt of an audio-only playing instruction in a process of synchronously playing audio and video of streaming media content using DASH, a request of obtaining audio data files of the streaming media content to a server, wherein video data files formed according to video content of the streaming media content and the audio data files formed according to audio content of the streaming media content are stored in the server; receiving the audio data files of the streaming media content from the server, and parsing out the audio content according to the audio data files; performing audio-only playing for the streaming media content according to the audio content.
    Type: Grant
    Filed: May 25, 2021
    Date of Patent: November 1, 2022
    Assignee: SHANGHAI BILIBILI TECHNOLOGY CO., LTD.
    Inventors: Zhiqiang Wu, Hanchao Zheng, Hui Chen
  • Patent number: 11475666
    Abstract: The present disclosure describes techniques for generating a mask frame data segment corresponding to a video frame. The disclosed techniques include obtaining a frame of a video; identifying a main area of the frame using an image segmentation algorithm; and generating a mask frame data segment corresponding to the frame based on the main area of the frame, wherein the generating a mask frame data segment corresponding to the frame based on the main area of the frame further comprises generating the mask frame data segment based on a timestamp of the frame in the video, a width and a height of the main area of the frame.
    Type: Grant
    Filed: May 13, 2020
    Date of Patent: October 18, 2022
    Assignee: Shanghai Bilibili Technology Co., Ltd.
    Inventors: Yingxuan Shi, Kangkang Zhang, Ruoheng Liu, Longwen Gao
  • Patent number: 11463494
    Abstract: A method includes: obtaining a video data file and an audio data file of streaming media content to be played from a server, when the streaming media content is played using DASH; obtaining a video bitrate from the video data file, and obtaining an audio bitrate from the audio data file; and determining a capacity of a video buffer area and a capacity of an audio buffer area according to the video bitrate and the audio bitrate.
    Type: Grant
    Filed: May 25, 2021
    Date of Patent: October 4, 2022
    Assignee: Shanghai Bilibili Technology Co., Ltd.
    Inventors: Hanchao Zheng, Zhiqiang Wu, Hui Chen
  • Patent number: 11451858
    Abstract: The present disclosure describes techniques of processing information flow and synchronously displaying image s, mask frames and comment information. According to the present disclosure, a system processes a first information stream uploaded by a stream pushing terminal to obtain a frame image and mask frame data, the mask frame data corresponding to the frame image and identifying a timestamp offset indicative of a time difference between the mask frame data and a playing timestamp of the frame image. The system synthesizes the frame image and the mask frame data to generate a second information stream; and output the second information stream to a client for synchronously displaying the image frame, a corresponding mask frame, and the comment information.
    Type: Grant
    Filed: September 11, 2020
    Date of Patent: September 20, 2022
    Assignee: SHANGHAI BILIBILI TECHNOLOGY CO., LTD.
    Inventors: Zhiwei Chen, Longwen Gao, Yingxuan Shi, Chaoran Li, Qi Tang, Jianqiang Ding, Bo Wang, Tianxiao Ye, Xiaolong Yan, Dada Liao, Xiang Zhu
  • Patent number: 11442606
    Abstract: The present disclosure describes techniques for implementing user interface interaction. The disclosed techniques comprise playing a video on an interface; monitoring user input performed on the interface; determining a target frame based at least in part on the user input; determining a location where the user input is performed on the interface; determining whether the location of the user input is in a predetermined area of the target frame, wherein the predetermined area is associated with at least one object in the target frame; and implementing an operation associated with the at least one object in response to determining that the location of the user input is in the predetermined area of the target frame.
    Type: Grant
    Filed: February 19, 2021
    Date of Patent: September 13, 2022
    Assignee: Shanghai Bilibili Technology Co., Ltd.
    Inventors: Yingxuan Shi, Lulu Yu, Chaoran Li, Zhiwei Chen, Longwen Gao
  • Patent number: 11417341
    Abstract: Techniques for processing comment information are disclosed herein. The disclosed techniques include collecting first voice information from a user in response to receiving a request for inputting voice information while the user is watching a video comprising a plurality of segments; obtaining a timestamp corresponding to a segment among the plurality of segments of the video; processing the first voice information and obtaining second voice information; and generating bullet screen information based at least in part on the timestamp and the second voice information.
    Type: Grant
    Filed: February 25, 2020
    Date of Patent: August 16, 2022
    Assignee: SHANGHAI BILIBILI TECHNOLOGY CO., LTD.
    Inventor: Yue Zhu
  • Patent number: 11400382
    Abstract: Techniques of generating and displaying an attention curve relative to a progress bar are described in the present disclosure.
    Type: Grant
    Filed: September 11, 2020
    Date of Patent: August 2, 2022
    Assignee: SHANGHAI BILIBILI TECHNOLOGY CO., LTD.
    Inventors: Junxing Tang, Pengcheng Li, Juan Chen, Zhiwei Chen, Hanming Li
  • Publication number: 20220207671
    Abstract: A computer-implemented method is provided that includes: collecting a first-format sample image and a second-format sample image obtained by shooting a same scene as a sample image pair; inputting the first-format sample image and the second-format sample image of a plurality of sample image pairs into a deep learning model for training with samples to obtain an optimized model; and inputting a first-format image to be converted into the optimized model for processing, and outputting a second-format image corresponding to the first-format image.
    Type: Application
    Filed: December 20, 2021
    Publication date: June 30, 2022
    Applicant: Shanghai Bilibili Technology Co., Ltd.
    Inventor: Yi WANG
  • Patent number: 11375203
    Abstract: Techniques for processing videos are described herein. The disclosed techniques include obtaining coding time parameters of coded frames of a video, the coding time parameters comprising a first parameter indicative of a coding time period for coding each frame under a non-waiting state and a second parameter indicative of a total time period during which each frame is in a coding process; and determining a coding complexity parameter for a frame to be coded based on the coding time parameters, wherein the determining a coding complexity parameter further comprises determining whether the coding complexity parameter is downgraded based on the second parameter, and in response to a determination that the coding complexity parameter is not downgraded, determining that the coding complexity parameter is upgraded based on the first parameter.
    Type: Grant
    Filed: June 27, 2019
    Date of Patent: June 28, 2022
    Assignee: SHANGHAI BILIBILI TECHNOLOGY CO., LTD.
    Inventor: Tianxiao Ye
  • Patent number: 11373688
    Abstract: The present disclosure describes techniques for generating dynamic image covers of multimedia files. The disclosed techniques comprise obtaining a multimedia file and a plurality of comments associated with the multimedia file, wherein each of the plurality of comments corresponds to a time point of playing the multimedia file, and a duration of playing the multimedia file is divided into a plurality of time periods; determining a status corresponding to each of the plurality of time periods based on a subset of comments among the plurality of comments corresponding to each of the plurality of time periods; identifying at least one time period among the plurality of time periods based on determining that a status corresponding to the at least time period satisfies at least one predetermined rule; and generating a dynamic cover of the multimedia file based on images comprised in the multimedia file during the at least one time period.
    Type: Grant
    Filed: September 25, 2020
    Date of Patent: June 28, 2022
    Assignee: SHANGHAI BILIBILI TECHNOLOGY CO., LTD.
    Inventor: Zhengxin Ling
  • Patent number: 11374995
    Abstract: Techniques for processing a multimedia file in real-time are described herein. The disclosed techniques include receiving a plurality of fragments of a multimedia file by a data stream conversion service, wherein the data stream conversion service receives a first fragment containing metadata of the multimedia file and then receives other fragments of the multimedia file in a predetermined order; sending a notification message to a message queue by the data stream conversion service in response to receiving the first fragment, wherein the notification message includes the metadata of the multimedia file and a corresponding Hyper Text Transfer Protocol (HTTP) interface address; obtaining the notification message from the message queue by an encoding and decoding service; and processing the other fragments of the multimedia file based at least in part on the notification message by the encoding and decoding service.
    Type: Grant
    Filed: May 16, 2019
    Date of Patent: June 28, 2022
    Assignee: SHANGHAI BILIBILI TECHNOLOGY CO., LTD.
    Inventors: Zhiwei Chen, Junxing Tang, Pengcheng Li, Longwen Gao, Yi Wang
  • Patent number: 11374843
    Abstract: A method of measuring a network speed, a computing device, and a computer-program product are provided. The method includes: obtaining a downloading duration and a downloading byte count of each of N consecutive video segments upon receiving a network speed measurement command during downloading video content, wherein the video content comprises multiple video segments; calculating out a total downloading duration and a total downloading byte count of the N video segments according to the downloading duration and the downloading byte count of each of the N video segments; and calculating out a current network speed according to the total downloading duration and the total downloading byte count.
    Type: Grant
    Filed: July 13, 2021
    Date of Patent: June 28, 2022
    Assignee: Shanghai Bilibili Technology Co., Ltd.
    Inventors: Hanchao Zheng, Zhiqiang Wu, Hui Chen
  • Patent number: 11343579
    Abstract: The present invention provides a method, device and computer-readable storage medium of intelligently buffering a Web video based on a browser, and belongs to a field of the Internet technology. The method, device and computer-readable storage medium of intelligently buffering a Web video based on a browser comprises a browser calculating an available buffer duration based on an available memory size of a buffer and a bit rate; initializing a player based on the available buffer duration; buffering and playing the video to be played using the player. So, the buffer duration can be set flexibly based on different browser platforms and an average bit rate of the video, which can maximize the use of a cache space, and effectively avoid the occurrence of sticking during video playback, and make better use of the bandwidth, so as to greatly improve the user experience.
    Type: Grant
    Filed: December 16, 2019
    Date of Patent: May 24, 2022
    Assignee: SHANGHAI BILIBILI TECHNOLOGY CO., LTD.
    Inventors: Zhaoxin Tan, Jianqiang Ding
  • Patent number: 11336711
    Abstract: A method of playing audio and video is provided. The method includes: obtaining a streaming media content to be encapsulated, and parsing the streaming media content to obtain audio parameter information and/or video parameter information; forming a Media Presentation Description (MPD) file in JavaScript Object Notation (JSON) format according to the audio parameter information and/or the video parameter information, wherein the MPD file in JSON format includes multiple streaming media content segments, each streaming media content segment includes a video segment and/or an audio segment, each of the video segment and the audio segment includes multiple arrays, and each array includes the audio parameter information or the video parameter information; sending the MPD file in JSON format to a client.
    Type: Grant
    Filed: June 25, 2021
    Date of Patent: May 17, 2022
    Assignee: Shanghai Bilibili Technology Co., Ltd.
    Inventors: Sheng Wang, Hanchao Zheng, Zhiqiang Wu, Hui Chen, Jianqiang Ding, Wenjie Fan, Zhaoxin Tan
  • Patent number: 11330338
    Abstract: The present disclosure describes techniques for displaying comments on videos. The disclosed techniques include obtaining a first list comprising a plurality of comment messages and a second list configured to store address information corresponding to at least one reusable comment style; determining whether the second list comprises the address information in response to a determination that a target comment message among the plurality of comment messages is initialized; selecting a piece of address information corresponding to a target comment style among the at least one reusable comment style in response to a determination that the second list comprises the address information; and generating a target comment object based on the target comment message and the target comment style corresponding to the selected piece of address information, wherein the target comment style comprises data indicative of effects of presenting the target comment message on a display device.
    Type: Grant
    Filed: June 18, 2020
    Date of Patent: May 10, 2022
    Assignee: SHANGHAI BILIBILI TECHNOLOGY CO., LTD.
    Inventors: Zhaoxin Tan, Jianqiang Ding, Fan Lan, Jianqiang Zhang
  • Patent number: 11316930
    Abstract: Embodiments of the present application provide a computer-implemented connection control method based on a QUIC protocol, comprising: receiving a QUIC connection request from a peer endpoint; analyzing the QUIC connection request and obtaining identification information of the peer endpoint; retrieving target historical information of the peer endpoint based on the identification information; adjusting a transport parameter based on the target historical information; establishing a QUIC connection with the peer endpoint based on an adjusted transport parameter; and controlling a connection state of the QUIC connection based on the adjusted transport parameter.
    Type: Grant
    Filed: October 17, 2019
    Date of Patent: April 26, 2022
    Assignee: SHANGHAI BILIBILI TECHNOLOGY CO., LTD.
    Inventors: Sheng Wang, Quan Zhou, Shangzhi Cai
  • Patent number: 11303949
    Abstract: A method of switching resolution is provided. The method includes: in playing audio and/or video using DASH, acquiring a media presentation description (MPD) file and obtaining resolution information through parsing the MPD file; during the playing of the audio and/or video, periodically determining a currently secure downloading speed according to a preset time interval and determining whether a resolution switching for the audio and/or video currently being played is required according to the secure downloading speed and the resolution information; and in accordance with a determination that the resolution switching is required, determining a switching time point according to an elapsed duration of a currently playing segment and a preset secure buffering duration and performing resolution switching at the switching time point.
    Type: Grant
    Filed: June 8, 2021
    Date of Patent: April 12, 2022
    Assignee: Shanghai Bilibili Technology Co., Ltd.
    Inventors: Zhiqiang Wu, Hanchao Zheng, Hui Chen, Jianqiang Ding, Zhaoxin Tan
  • Patent number: 11184465
    Abstract: Techniques for network communication are described herein. The disclosed techniques include generating a request for accessing a target server by a computing device, the request comprising a URL; determining whether to select a QUIC transport protocol based on the URI; selecting the QUIC transport protocol in response to a determination that the URL comprises QUIC identification information; and establishing a QUIC connection with the target server via a QUIC stack of the computing device according to the QUIC transport protocol.
    Type: Grant
    Filed: October 17, 2019
    Date of Patent: November 23, 2021
    Assignee: SHANGHAI BILIBILI TECHNOLOGY CO., LTD.
    Inventors: Sheng Wang, Quan Zhou, Shangzhi Cai
  • Publication number: 20210352127
    Abstract: A method of playing audio and video is provided. The method includes: obtaining a streaming media content to be encapsulated, and parsing the streaming media content to obtain audio parameter information and/or video parameter information; forming a Media Presentation Description (MPD) file in JavaScript Object Notation (JSON) format according to the audio parameter information and/or the video parameter information, wherein the MPD file in JSON format includes multiple streaming media content segments, each streaming media content segment includes a video segment and/or an audio segment, each of the video segment and the audio segment includes multiple arrays, and each array includes the audio parameter information or the video parameter information; sending the MPD file in JSON format to a client.
    Type: Application
    Filed: June 25, 2021
    Publication date: November 11, 2021
    Applicant: Shanghai Bilibili Technology Co., Ltd.
    Inventors: Sheng Wang, Hanchao Zheng, Zhiqiang Wu, Hui Chen, Jianqiang Ding, Wenjie Fan, Zhaoxin Tan