Patents by Inventor Daming Lu

Daming Lu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11935214
    Abstract: Presented herein are systems and methods for an end-to-end solution for object removal from a video using adaptive learning. In one or more embodiments, using a pre-trained image inpainting model, in-scene training data may be generated using optical-flow guided sampling. In one or more embodiments, the sampled patches are used to generate a training dataset, which is used to further train the image inpainting model until reaching a stop condition. The adaptively trained inpainting model may be used to generate a modified video in which the desired object or objects have been removed and the corresponding removed portion(s) have been filled (or inpainted) to preserve the integrity of the image.
    Type: Grant
    Filed: January 27, 2021
    Date of Patent: March 19, 2024
    Assignee: Baidu USA LLC
    Inventors: Zhihong Pan, Daming Lu, Xi Chen
  • Patent number: 11758088
    Abstract: Embodiments of the present disclosure provide a method and apparatus for aligning a paragraph and a video. The method may include: acquiring a commentary and a candidate material resource set corresponding to the commentary, a candidate material resource being a video or an image; acquiring a matching degree between each paragraph in the commentary and each candidate material resource in the candidate material resource set; and determining a candidate material resource sequence corresponding to the each paragraph in the commentary based on the matching degrees between the paragraphs in the commentary and the candidate material resources, playing durations of the candidate material resources and text lengths of the paragraphs in the commentary, an image playing duration being a preset image playing duration.
    Type: Grant
    Filed: December 4, 2019
    Date of Patent: September 12, 2023
    Assignees: Baidu.com Times Technology (Beijing) Co., Ltd., Baidu USA LLC
    Inventors: Hao Tian, Xi Chen, Jeff ChienYu Wang, Daming Lu
  • Patent number: 11687711
    Abstract: Embodiments of the present disclosure provide a method and apparatus for generating a commentary. The method may include: acquiring at least one news cluster composed of pieces of news generated within a first preset time length, the pieces of news in the news cluster direct to a given news event; determining a target news cluster based on the at least one news cluster; determining, for each piece of news in the target news cluster, a score of being suitable for generating a commentary for the piece of news; and generating, based on a piece of target news, a commentary for the target news cluster, where the piece of target news is a piece of news having a highest score of being suitable for generating a commentary in the target news cluster.
    Type: Grant
    Filed: December 4, 2019
    Date of Patent: June 27, 2023
    Assignee: BAIDU.COM TIMES TECHNOLOGY (BEIJING) CO., LTD.
    Inventors: Hao Tian, Xi Chen, Jeff ChienYu Wang, Daming Lu
  • Publication number: 20230100305
    Abstract: According to one embodiment, a method is provided for video repainting performed by at least one processor of a computer device. The method includes receiving a video sequence having one or more image frames; detecting presences of a target object within the one or more image frames and determining pose condition and style shift of the detected objects; generating content representing a replacement object for the one or more image frames by applying the corresponding pose condition and style shift to the replacement object; and repainting the detected target object in the one or more image frames with the generated content.
    Type: Application
    Filed: September 27, 2021
    Publication date: March 30, 2023
    Inventors: ZHIHONG PAN, DAMING LU, XI CHEN
  • Publication number: 20220237750
    Abstract: Presented herein are systems and methods for an end-to-end solution for object removal from a video using adaptive learning. In one or more embodiments, using a pre-trained image inpainting models, in-scene training data may be generated using optical-flow guided sampling. In one or more embodiments, the sampled patches are used to generate a training dataset, which is used to further train the image inpainting model until reaching a stop condition. The adaptively trained inpainting model may be used to generate a modified video in which the desired object or objects have been removed and the corresponding removed portion(s) have been filled (or inpainted) to preserve the integrity of the image.
    Type: Application
    Filed: January 27, 2021
    Publication date: July 28, 2022
    Applicant: Baidu USA LLC
    Inventors: Zhihong PAN, Daming LU, XI CHEN
  • Publication number: 20220189173
    Abstract: Presented herein are systems, methods, and datasets for automatically and precisely generating highlight or summary videos of content. In one or more embodiments, the inputs comprise a text (e.g., an article) of the key event(s) (e.g., a goal, a player action, etc.) in an activity (e.g., a game, a concert, etc.) and a video or videos of the activity. In one or more embodiments, the output is a short video of an event or events in the text, in which the video may include commentary about the highlighted events and/or other audio (e.g., music), which may also be automatically synthesized.
    Type: Application
    Filed: November 23, 2021
    Publication date: June 16, 2022
    Applicant: Baidu USA LLC
    Inventors: Xin ZHOU, Le KANG, Zhiyu CHENG, Hao TIAN, Daming LU, Dapeng LI, Jingya XUN, Jeff WANG, Xi CHEN, Xing LI
  • Publication number: 20220174369
    Abstract: The present disclosure provides examples of a method and apparatus for processing a video, a device and a storage medium. The method may include: acquiring a target video and a target comment of the target video; recognizing a picture in the target video to obtain text information of the picture; determining a target comment matching a content of the text information; and inserting, in response to displaying the picture in the target video, the target comment matching the content in a form of a bullet screen.
    Type: Application
    Filed: February 18, 2022
    Publication date: June 2, 2022
    Inventors: Daming LU, Yichen HU, Xi CHEN, Hao TIAN, Xing LI
  • Patent number: 11036996
    Abstract: The present disclosure discloses a method and apparatus for determining video material of news. The method for determining video material of news comprises: recognizing a person name in a news text; searching a video based on the person name, to obtain a to-be-selected video; extracting a key frame in the to-be-selected video; recognizing a person in the key frame to obtain identity information of the person; and determining the to-be-selected video as video material of news, in response to the identity information of the person conforming to the person name. The present disclosure improves the consistency between the video material of the news and the news text.
    Type: Grant
    Filed: July 2, 2019
    Date of Patent: June 15, 2021
    Assignee: Baidu USA LLC
    Inventors: Daming Lu, Hao Tian
  • Publication number: 20210004602
    Abstract: The present disclosure discloses a method and apparatus for determining video material of news. The method for determining video material of news comprises: acquiring a weighted score value of a score of a keyword of a news text in a plurality of dimensions; filtering a keyword set of news based on the weighted score value of the score of the keyword; searching a pre-selected video using the keyword set of the news; and determining video material of the news based on the pre-selected video. The present disclosure improves the consistency between the video material of the news and the news text.
    Type: Application
    Filed: July 2, 2019
    Publication date: January 7, 2021
    Inventors: Daming Lu, Hao Tian
  • Publication number: 20210004603
    Abstract: The present disclosure discloses a method and apparatus for determining video material of news. The method for determining video material of news comprises: recognizing a person name in a news text; searching a video based on the person name, to obtain a to-be-selected video; extracting a key frame in the to-be-selected video; recognizing a person in the key frame to obtain identity information of the person; and determining the to-be-selected video as video material of news, in response to the identity information of the person conforming to the person name. The present disclosure improves the consistency between the video material of the news and the news text.
    Type: Application
    Filed: July 2, 2019
    Publication date: January 7, 2021
    Inventors: Daming Lu, Hao Tian
  • Patent number: 10878247
    Abstract: Embodiments of the present disclosure provide a method and apparatus for generating information. The method may include: determining at least one video segment obtained by semantically segmenting videos included in a target news cluster as a target video set, where respective pieces of news in the target news cluster directs to a given news event; determining a commentary for the target news cluster; determining, based on the target video set and a target image set, a candidate material resource set corresponding to the commentary, where the target image set is composed of respective images included in the target news cluster; and for each paragraph in the commentary, determining degrees of matching between the paragraph and candidate material resources in the candidate material resource set.
    Type: Grant
    Filed: December 4, 2019
    Date of Patent: December 29, 2020
    Assignees: Baidu.com Times Technology (Beijing) Co., Ltd., Baidu USA LLC
    Inventors: Hao Tian, Xi Chen, Jeff ChienYu Wang, Daming Lu
  • Publication number: 20200320306
    Abstract: Embodiments of the present disclosure provide a method and apparatus for generating information. The method may include: determining at least one video segment obtained by semantically segmenting videos included in a target news cluster as a target video set, where respective pieces of news in the target news cluster directs to a given news event; determining a commentary for the target news cluster; determining, based on the target video set and a target image set, a candidate material resource set corresponding to the commentary, where the target image set is composed of respective images included in the target news cluster; and for each paragraph in the commentary, determining degrees of matching between the paragraph and candidate material resources in the candidate material resource set.
    Type: Application
    Filed: December 4, 2019
    Publication date: October 8, 2020
    Inventors: Hao TIAN, Xi CHEN, Jeff ChienYu WANG, Daming LU
  • Publication number: 20200320307
    Abstract: Embodiments of the present disclosure provide a method and apparatus for generating a video. The method may include: determining a commentary of a target news cluster, each piece of news in the target news cluster being specific to a given news event; generating a voice corresponding to each paragraph in the commentary using a speech synthesis technology; determining a candidate material resource set corresponding to the commentary based on a video and an image included in the target news cluster, the candidate material resource being a video or image; determining a candidate material resource sequence corresponding to the each paragraph in the commentary; and generating a video corresponding to the commentary based on the voice corresponding to the each paragraph in the commentary and the candidate material resource sequence.
    Type: Application
    Filed: December 4, 2019
    Publication date: October 8, 2020
    Inventors: Hao TIAN, Daming LU, Xi CHEN, Jeff ChienYu WANG
  • Publication number: 20200322570
    Abstract: Embodiments of the present disclosure provide a method and apparatus for aligning a paragraph and a video. The method may include: acquiring a commentary and a candidate material resource set corresponding to the commentary, a candidate material resource being a video or an image; acquiring a matching degree between each paragraph in the commentary and each candidate material resource in the candidate material resource set; and determining a candidate material resource sequence corresponding to the each paragraph in the commentary based on the matching degrees between the paragraphs in the commentary and the candidate material resources, playing durations of the candidate material resources and text lengths of the paragraphs in the commentary, an image playing duration being a preset image playing duration.
    Type: Application
    Filed: December 4, 2019
    Publication date: October 8, 2020
    Inventors: Hao TIAN, Xi CHEN, Jeff ChienYu WANG, Daming LU
  • Publication number: 20200321026
    Abstract: Embodiments of the present disclosure provide a method and apparatus for generating a video. The method may include: receiving a query text inputted by a user; querying a material resource set related to the query text, material resources being images, videos, or audios; presenting the material resource set; determining a material resource sequence, in response to receiving a selecting operation and a ranking operation of the user on the material resources in the presented material resource set; and generating the video based on the material resource sequence.
    Type: Application
    Filed: December 4, 2019
    Publication date: October 8, 2020
    Inventors: Hao TIAN, Daming LU, Xi CHEN, Jeff ChienYu WANG
  • Publication number: 20200320253
    Abstract: Embodiments of the present disclosure provide a method and apparatus for generating a commentary. The method may include: acquiring at least one news cluster composed of pieces of news generated within a first preset time length, the pieces of news in the news cluster direct to a given news event; determining a target news cluster based on the at least one news cluster; determining, for each piece of news in the target news cluster, a score of being suitable for generating a commentary for the piece of news; and generating, based on a piece of target news, a commentary for the target news cluster, where the piece of target news is a piece of news having a highest score of being suitable for generating a commentary in the target news cluster.
    Type: Application
    Filed: December 4, 2019
    Publication date: October 8, 2020
    Inventors: Hao TIAN, Xi CHEN, Jeff ChienYu WANG, Daming LU
  • Patent number: 10699127
    Abstract: A method and apparatus for adjusting a parameter are provided. The method may include: acquiring a current value of at least one parameter which is in a process of generating a video corresponding to a commentary of the news cluster based on a news cluster; determining a video evaluation score of the video which is generated based on the news cluster and according to the current value of the at least one parameter; performing feature extraction on the current value of the at least one parameter to obtain a feature representation; inputting the feature representation and the determined video evaluation score into a pre-trained evaluation network to obtain a predicted video evaluation score; inputting the feature representation and the predicted video evaluation score into a pre-trained operation network, to obtain current operation information; and adjusting the current value of the at least one parameter based on the current operation information.
    Type: Grant
    Filed: December 4, 2019
    Date of Patent: June 30, 2020
    Assignees: Baidu.com Times Technology (Beijing) Co., Ltd., Baidu USA LLC
    Inventors: Hao Tian, Daming Lu, Xi Chen, Jeff ChienYu Wang
  • Patent number: 8984052
    Abstract: The present invention provides a method for customizing application services of a data card. The system comprises a data card and an over-the-air server. The method comprises: the data card sending an application service customization request to the over-the-air server when an application service is required to be customized; and the over-the-air server receiving the application service customization request, and then returning a configuration command corresponding to configuration information to the data card if it is determined that an operation of the data card to request customization of the application service is valid according to the stored and managed configuration information of all application services supported by the data card.
    Type: Grant
    Filed: April 15, 2011
    Date of Patent: March 17, 2015
    Assignee: ZTE Corporation
    Inventors: Yuanyuan Chen, Daming Lu, Jiangfeng Shang
  • Publication number: 20130044638
    Abstract: A system for implementing an access point name setting is disclosed, including: a mobile terminal and an access point name server, wherein, the mobile terminal is configured to: when access point name information is required to be set, send an access point name inquiry request to the access point name server; the access point name server is configured to: after receiving the access point name inquiry request of the mobile terminal, carry the access point name information corresponding to the mobile terminal in an access point name inquiry response to return to the mobile terminal. A mobile terminal and method for implementing the access point name setting are also disclosed. The mobile terminal is enabled to perform automatic setting for an APN conveniently, bringing great convenience to a mobile terminal user.
    Type: Application
    Filed: April 18, 2011
    Publication date: February 21, 2013
    Applicant: ZTE CORPORATION
    Inventors: Daming Lu, Rui Zhang, Lijun Fang, Gang Tao, Hongtao Zheng
  • Publication number: 20130036161
    Abstract: The present invention provides a method for customizing application services of a data card. The system comprises a data card and an over-the-air server. The method comprises: the data card sending an application service customization request to the over-the-air server when an application service is required to be customized; and the over-the-air server receiving the application service customization request, and then returning a configuration command corresponding to configuration information to the data card if it is determined that an operation of the data card to request customization of the application service is valid according to the stored and managed configuration information of all application services supported by the data card.
    Type: Application
    Filed: April 15, 2011
    Publication date: February 7, 2013
    Applicant: ZTE CORPORATION
    Inventors: Yuanyuan Chen, Daming Lu, Jiangfeng Shang