Patents by Inventor Daming Lu
Daming Lu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11935214Abstract: Presented herein are systems and methods for an end-to-end solution for object removal from a video using adaptive learning. In one or more embodiments, using a pre-trained image inpainting model, in-scene training data may be generated using optical-flow guided sampling. In one or more embodiments, the sampled patches are used to generate a training dataset, which is used to further train the image inpainting model until reaching a stop condition. The adaptively trained inpainting model may be used to generate a modified video in which the desired object or objects have been removed and the corresponding removed portion(s) have been filled (or inpainted) to preserve the integrity of the image.Type: GrantFiled: January 27, 2021Date of Patent: March 19, 2024Assignee: Baidu USA LLCInventors: Zhihong Pan, Daming Lu, Xi Chen
-
Patent number: 11758088Abstract: Embodiments of the present disclosure provide a method and apparatus for aligning a paragraph and a video. The method may include: acquiring a commentary and a candidate material resource set corresponding to the commentary, a candidate material resource being a video or an image; acquiring a matching degree between each paragraph in the commentary and each candidate material resource in the candidate material resource set; and determining a candidate material resource sequence corresponding to the each paragraph in the commentary based on the matching degrees between the paragraphs in the commentary and the candidate material resources, playing durations of the candidate material resources and text lengths of the paragraphs in the commentary, an image playing duration being a preset image playing duration.Type: GrantFiled: December 4, 2019Date of Patent: September 12, 2023Assignees: Baidu.com Times Technology (Beijing) Co., Ltd., Baidu USA LLCInventors: Hao Tian, Xi Chen, Jeff ChienYu Wang, Daming Lu
-
Patent number: 11687711Abstract: Embodiments of the present disclosure provide a method and apparatus for generating a commentary. The method may include: acquiring at least one news cluster composed of pieces of news generated within a first preset time length, the pieces of news in the news cluster direct to a given news event; determining a target news cluster based on the at least one news cluster; determining, for each piece of news in the target news cluster, a score of being suitable for generating a commentary for the piece of news; and generating, based on a piece of target news, a commentary for the target news cluster, where the piece of target news is a piece of news having a highest score of being suitable for generating a commentary in the target news cluster.Type: GrantFiled: December 4, 2019Date of Patent: June 27, 2023Assignee: BAIDU.COM TIMES TECHNOLOGY (BEIJING) CO., LTD.Inventors: Hao Tian, Xi Chen, Jeff ChienYu Wang, Daming Lu
-
Publication number: 20230100305Abstract: According to one embodiment, a method is provided for video repainting performed by at least one processor of a computer device. The method includes receiving a video sequence having one or more image frames; detecting presences of a target object within the one or more image frames and determining pose condition and style shift of the detected objects; generating content representing a replacement object for the one or more image frames by applying the corresponding pose condition and style shift to the replacement object; and repainting the detected target object in the one or more image frames with the generated content.Type: ApplicationFiled: September 27, 2021Publication date: March 30, 2023Inventors: ZHIHONG PAN, DAMING LU, XI CHEN
-
Publication number: 20220237750Abstract: Presented herein are systems and methods for an end-to-end solution for object removal from a video using adaptive learning. In one or more embodiments, using a pre-trained image inpainting models, in-scene training data may be generated using optical-flow guided sampling. In one or more embodiments, the sampled patches are used to generate a training dataset, which is used to further train the image inpainting model until reaching a stop condition. The adaptively trained inpainting model may be used to generate a modified video in which the desired object or objects have been removed and the corresponding removed portion(s) have been filled (or inpainted) to preserve the integrity of the image.Type: ApplicationFiled: January 27, 2021Publication date: July 28, 2022Applicant: Baidu USA LLCInventors: Zhihong PAN, Daming LU, XI CHEN
-
Publication number: 20220189173Abstract: Presented herein are systems, methods, and datasets for automatically and precisely generating highlight or summary videos of content. In one or more embodiments, the inputs comprise a text (e.g., an article) of the key event(s) (e.g., a goal, a player action, etc.) in an activity (e.g., a game, a concert, etc.) and a video or videos of the activity. In one or more embodiments, the output is a short video of an event or events in the text, in which the video may include commentary about the highlighted events and/or other audio (e.g., music), which may also be automatically synthesized.Type: ApplicationFiled: November 23, 2021Publication date: June 16, 2022Applicant: Baidu USA LLCInventors: Xin ZHOU, Le KANG, Zhiyu CHENG, Hao TIAN, Daming LU, Dapeng LI, Jingya XUN, Jeff WANG, Xi CHEN, Xing LI
-
Publication number: 20220174369Abstract: The present disclosure provides examples of a method and apparatus for processing a video, a device and a storage medium. The method may include: acquiring a target video and a target comment of the target video; recognizing a picture in the target video to obtain text information of the picture; determining a target comment matching a content of the text information; and inserting, in response to displaying the picture in the target video, the target comment matching the content in a form of a bullet screen.Type: ApplicationFiled: February 18, 2022Publication date: June 2, 2022Inventors: Daming LU, Yichen HU, Xi CHEN, Hao TIAN, Xing LI
-
Patent number: 11036996Abstract: The present disclosure discloses a method and apparatus for determining video material of news. The method for determining video material of news comprises: recognizing a person name in a news text; searching a video based on the person name, to obtain a to-be-selected video; extracting a key frame in the to-be-selected video; recognizing a person in the key frame to obtain identity information of the person; and determining the to-be-selected video as video material of news, in response to the identity information of the person conforming to the person name. The present disclosure improves the consistency between the video material of the news and the news text.Type: GrantFiled: July 2, 2019Date of Patent: June 15, 2021Assignee: Baidu USA LLCInventors: Daming Lu, Hao Tian
-
Publication number: 20210004602Abstract: The present disclosure discloses a method and apparatus for determining video material of news. The method for determining video material of news comprises: acquiring a weighted score value of a score of a keyword of a news text in a plurality of dimensions; filtering a keyword set of news based on the weighted score value of the score of the keyword; searching a pre-selected video using the keyword set of the news; and determining video material of the news based on the pre-selected video. The present disclosure improves the consistency between the video material of the news and the news text.Type: ApplicationFiled: July 2, 2019Publication date: January 7, 2021Inventors: Daming Lu, Hao Tian
-
Publication number: 20210004603Abstract: The present disclosure discloses a method and apparatus for determining video material of news. The method for determining video material of news comprises: recognizing a person name in a news text; searching a video based on the person name, to obtain a to-be-selected video; extracting a key frame in the to-be-selected video; recognizing a person in the key frame to obtain identity information of the person; and determining the to-be-selected video as video material of news, in response to the identity information of the person conforming to the person name. The present disclosure improves the consistency between the video material of the news and the news text.Type: ApplicationFiled: July 2, 2019Publication date: January 7, 2021Inventors: Daming Lu, Hao Tian
-
Patent number: 10878247Abstract: Embodiments of the present disclosure provide a method and apparatus for generating information. The method may include: determining at least one video segment obtained by semantically segmenting videos included in a target news cluster as a target video set, where respective pieces of news in the target news cluster directs to a given news event; determining a commentary for the target news cluster; determining, based on the target video set and a target image set, a candidate material resource set corresponding to the commentary, where the target image set is composed of respective images included in the target news cluster; and for each paragraph in the commentary, determining degrees of matching between the paragraph and candidate material resources in the candidate material resource set.Type: GrantFiled: December 4, 2019Date of Patent: December 29, 2020Assignees: Baidu.com Times Technology (Beijing) Co., Ltd., Baidu USA LLCInventors: Hao Tian, Xi Chen, Jeff ChienYu Wang, Daming Lu
-
Publication number: 20200320306Abstract: Embodiments of the present disclosure provide a method and apparatus for generating information. The method may include: determining at least one video segment obtained by semantically segmenting videos included in a target news cluster as a target video set, where respective pieces of news in the target news cluster directs to a given news event; determining a commentary for the target news cluster; determining, based on the target video set and a target image set, a candidate material resource set corresponding to the commentary, where the target image set is composed of respective images included in the target news cluster; and for each paragraph in the commentary, determining degrees of matching between the paragraph and candidate material resources in the candidate material resource set.Type: ApplicationFiled: December 4, 2019Publication date: October 8, 2020Inventors: Hao TIAN, Xi CHEN, Jeff ChienYu WANG, Daming LU
-
Publication number: 20200320307Abstract: Embodiments of the present disclosure provide a method and apparatus for generating a video. The method may include: determining a commentary of a target news cluster, each piece of news in the target news cluster being specific to a given news event; generating a voice corresponding to each paragraph in the commentary using a speech synthesis technology; determining a candidate material resource set corresponding to the commentary based on a video and an image included in the target news cluster, the candidate material resource being a video or image; determining a candidate material resource sequence corresponding to the each paragraph in the commentary; and generating a video corresponding to the commentary based on the voice corresponding to the each paragraph in the commentary and the candidate material resource sequence.Type: ApplicationFiled: December 4, 2019Publication date: October 8, 2020Inventors: Hao TIAN, Daming LU, Xi CHEN, Jeff ChienYu WANG
-
Publication number: 20200322570Abstract: Embodiments of the present disclosure provide a method and apparatus for aligning a paragraph and a video. The method may include: acquiring a commentary and a candidate material resource set corresponding to the commentary, a candidate material resource being a video or an image; acquiring a matching degree between each paragraph in the commentary and each candidate material resource in the candidate material resource set; and determining a candidate material resource sequence corresponding to the each paragraph in the commentary based on the matching degrees between the paragraphs in the commentary and the candidate material resources, playing durations of the candidate material resources and text lengths of the paragraphs in the commentary, an image playing duration being a preset image playing duration.Type: ApplicationFiled: December 4, 2019Publication date: October 8, 2020Inventors: Hao TIAN, Xi CHEN, Jeff ChienYu WANG, Daming LU
-
Publication number: 20200321026Abstract: Embodiments of the present disclosure provide a method and apparatus for generating a video. The method may include: receiving a query text inputted by a user; querying a material resource set related to the query text, material resources being images, videos, or audios; presenting the material resource set; determining a material resource sequence, in response to receiving a selecting operation and a ranking operation of the user on the material resources in the presented material resource set; and generating the video based on the material resource sequence.Type: ApplicationFiled: December 4, 2019Publication date: October 8, 2020Inventors: Hao TIAN, Daming LU, Xi CHEN, Jeff ChienYu WANG
-
Publication number: 20200320253Abstract: Embodiments of the present disclosure provide a method and apparatus for generating a commentary. The method may include: acquiring at least one news cluster composed of pieces of news generated within a first preset time length, the pieces of news in the news cluster direct to a given news event; determining a target news cluster based on the at least one news cluster; determining, for each piece of news in the target news cluster, a score of being suitable for generating a commentary for the piece of news; and generating, based on a piece of target news, a commentary for the target news cluster, where the piece of target news is a piece of news having a highest score of being suitable for generating a commentary in the target news cluster.Type: ApplicationFiled: December 4, 2019Publication date: October 8, 2020Inventors: Hao TIAN, Xi CHEN, Jeff ChienYu WANG, Daming LU
-
Patent number: 10699127Abstract: A method and apparatus for adjusting a parameter are provided. The method may include: acquiring a current value of at least one parameter which is in a process of generating a video corresponding to a commentary of the news cluster based on a news cluster; determining a video evaluation score of the video which is generated based on the news cluster and according to the current value of the at least one parameter; performing feature extraction on the current value of the at least one parameter to obtain a feature representation; inputting the feature representation and the determined video evaluation score into a pre-trained evaluation network to obtain a predicted video evaluation score; inputting the feature representation and the predicted video evaluation score into a pre-trained operation network, to obtain current operation information; and adjusting the current value of the at least one parameter based on the current operation information.Type: GrantFiled: December 4, 2019Date of Patent: June 30, 2020Assignees: Baidu.com Times Technology (Beijing) Co., Ltd., Baidu USA LLCInventors: Hao Tian, Daming Lu, Xi Chen, Jeff ChienYu Wang
-
Patent number: 8984052Abstract: The present invention provides a method for customizing application services of a data card. The system comprises a data card and an over-the-air server. The method comprises: the data card sending an application service customization request to the over-the-air server when an application service is required to be customized; and the over-the-air server receiving the application service customization request, and then returning a configuration command corresponding to configuration information to the data card if it is determined that an operation of the data card to request customization of the application service is valid according to the stored and managed configuration information of all application services supported by the data card.Type: GrantFiled: April 15, 2011Date of Patent: March 17, 2015Assignee: ZTE CorporationInventors: Yuanyuan Chen, Daming Lu, Jiangfeng Shang
-
Publication number: 20130044638Abstract: A system for implementing an access point name setting is disclosed, including: a mobile terminal and an access point name server, wherein, the mobile terminal is configured to: when access point name information is required to be set, send an access point name inquiry request to the access point name server; the access point name server is configured to: after receiving the access point name inquiry request of the mobile terminal, carry the access point name information corresponding to the mobile terminal in an access point name inquiry response to return to the mobile terminal. A mobile terminal and method for implementing the access point name setting are also disclosed. The mobile terminal is enabled to perform automatic setting for an APN conveniently, bringing great convenience to a mobile terminal user.Type: ApplicationFiled: April 18, 2011Publication date: February 21, 2013Applicant: ZTE CORPORATIONInventors: Daming Lu, Rui Zhang, Lijun Fang, Gang Tao, Hongtao Zheng
-
Publication number: 20130036161Abstract: The present invention provides a method for customizing application services of a data card. The system comprises a data card and an over-the-air server. The method comprises: the data card sending an application service customization request to the over-the-air server when an application service is required to be customized; and the over-the-air server receiving the application service customization request, and then returning a configuration command corresponding to configuration information to the data card if it is determined that an operation of the data card to request customization of the application service is valid according to the stored and managed configuration information of all application services supported by the data card.Type: ApplicationFiled: April 15, 2011Publication date: February 7, 2013Applicant: ZTE CORPORATIONInventors: Yuanyuan Chen, Daming Lu, Jiangfeng Shang