Patents by Inventor Xiao Rui Shao

Xiao Rui Shao has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11645110
    Abstract: Aspects of the present disclosure relate to automatically generating a user manual using a technique that includes training a first model with a first set of training data. The technique further includes generating, by the first model, a set of operations and a set of windows, where the set of operations and the set of windows are functions of the program. The technique further includes, generating a plurality of tasks, where a first task comprises a first operation being performed on a first window. The technique further includes determining an order of the plurality of tasks and calculating a level score for the first operation of the first window. The technique further includes assembling the user manual having the plurality of tasks in the determined order.
    Type: Grant
    Filed: March 13, 2019
    Date of Patent: May 9, 2023
    Assignee: International Business Machines Corporation
    Inventors: Xiao Feng Ji, Yuan Jin, Li ping Wang, Xiao Rui Shao
  • Patent number: 10834355
    Abstract: Approaches presented herein enable displaying a barrage message. Specifically, one or more objects and location information for each object in a frame of a video are identified. A barrage message to be displayed in the frame of the video is obtained. The barrage message is displayed without covering any object in the frame.
    Type: Grant
    Filed: March 25, 2019
    Date of Patent: November 10, 2020
    Assignee: International Business Machines Corporation
    Inventors: Xiao Cao Cao, Yu Huang, Yuan Jin, Chengyu Peng, Yin Qian, Xiao Rui Shao, Jian Jun Wang
  • Publication number: 20200293825
    Abstract: Aspects of the present disclosure relate to automatically generating a user manual using a technique that includes training a first model with a first set of training data. The technique further includes generating, by the first model, a set of operations and a set of windows, where the set of operations and the set of windows are functions of the program. The technique further includes, generating a plurality of tasks, where a first task comprises a first operation being performed on a first window. The technique further includes determining an order of the plurality of tasks and calculating a level score for the first operation of the first window. The technique further includes assembling the user manual having the plurality of tasks in the determined order.
    Type: Application
    Filed: March 13, 2019
    Publication date: September 17, 2020
    Inventors: Xiao Feng Ji, Yuan Jin, Li ping Wang, Xiao Rui Shao
  • Patent number: 10607652
    Abstract: A method and system of converting a first language of a soundtrack of a person speaking in a video to a second language. A meaning of a word of the first language is translated, and one or more synonym words in the second language stored in a database of the computer system is located. The first and second languages are different languages. Outlines of shapes of mouth openings of the one or more synonym words in the second language are compared with the outlines of the shapes of mouth openings of the word of the first language. A synonym word of the one or more synonym words translated from the second language into the first language having mouth openings with a smallest difference from the mouth openings of the word of the first language is selected.
    Type: Grant
    Filed: April 1, 2019
    Date of Patent: March 31, 2020
    Assignee: International Business Machines Corporation
    Inventors: Yuan Jin, Cheng Yu Peng, Yin Qian, Xiao Rui Shao, Jian Jun Wang
  • Patent number: 10558701
    Abstract: Disclosed embodiments provide techniques for suggesting images that can be conveniently included in electronic communication such as social media posts, emails, text messages, and other forms of electronic communication, based on voice input and/or emotion analysis from facial expressions of a user. A speech-to-text process converts a user's spoken utterance to text. Natural language processing performs an entity extraction on the utterance to generate a scenario summary. An image database is queried using the scenario summary and/or emotion analysis based on user facial images. A mapping rule library may be used to perform the image database query. Based on the scenario summary and/or the emotion analysis, images are presented to the user as recommended for including in an electronic communication message such as a social media post, email, or text message.
    Type: Grant
    Filed: February 8, 2017
    Date of Patent: February 11, 2020
    Assignee: International Business Machines Corporation
    Inventors: Jin Long L L He, Yu Hong Y L Li, Xiao Rui Shao, Fei F. Shen, Jian Jun Wang
  • Publication number: 20190228805
    Abstract: A method and system of converting a first language of a soundtrack of a person speaking in a video to a second language. A meaning of a word of the first language is translated, and one or more synonym words in the second language stored in a database of the computer system is located. The first and second languages are different languages. Outlines of shapes of mouth openings of the one or more synonym words in the second language are compared with the outlines of the shapes of mouth openings of the word of the first language. A synonym word of the one or more synonym words translated from the second language into the first language having mouth openings with a smallest difference from the mouth openings of the word of the first language is selected.
    Type: Application
    Filed: April 1, 2019
    Publication date: July 25, 2019
    Inventors: Yuan Jin, Cheng Yu Peng, Yin Qian, Xiao Rui Shao, Jian Jun Wang
  • Publication number: 20190222792
    Abstract: Approaches presented herein enable displaying a barrage message. Specifically, one or more objects and location information for each object in a frame of a video are identified. A barrage message to be displayed in the frame of the video is obtained. The barrage message is displayed without covering any object in the frame.
    Type: Application
    Filed: March 25, 2019
    Publication date: July 18, 2019
    Inventors: Xiao Cao Cao, Yu Huang, Yuan Jin, Chengyu Peng, Yin Qian, Xiao Rui Shao, Jian Jun Wang
  • Patent number: 10339973
    Abstract: The present invention provides a method and system for converting a first language of a soundtrack of a person speaking in a video to a second language. The method defines an outline of a shape of a mouth opening of the person speaking a syllable of a word of the first language in the video at a given start time by selecting a predetermined number of points along a border of the mouth opening defined by the lips. A length of the spoken syllable is also measured and one or more adjacent syllables are combined to create a word. The word is translated into synonym words in the second language, the best fit synonym word is selected that most closely matches the mouth shape of the first language word, and a mouth shape adjustment script is applied to fine tune the mouth shape of the best fit synonym word.
    Type: Grant
    Filed: February 13, 2017
    Date of Patent: July 2, 2019
    Assignee: International Business Machines Corporation
    Inventors: Yuan Jin, Cheng Yu Peng, Yin Qian, Xiao Rui Shao, Jian Jun Wang
  • Patent number: 10284806
    Abstract: Approaches presented herein enable displaying a barrage message. Specifically, one or more objects and location information for each object in a frame of a video are identified. A barrage message to be displayed in the frame of the video is obtained. The barrage message is displayed without covering any object in the frame.
    Type: Grant
    Filed: January 4, 2017
    Date of Patent: May 7, 2019
    Assignee: International Business Machines Corporation
    Inventors: Xiao Cao Cao, Yu Huang, Yuan Jin, Chengyu Peng, Yin Qian, Xiao Rui Shao, Jian Jun Wang
  • Publication number: 20180232363
    Abstract: The present invention provides a method and system for converting a first language of a soundtrack of a person speaking in a video to a second language. The method defines an outline of a shape of a mouth opening of the person speaking a syllable of a word of the first language in the video at a given start time by selecting a predetermined number of points along a border of the mouth opening defined by the lips. A length of the spoken syllable is also measured and one or more adjacent syllables are combined to create a word. The word is translated into synonym words in the second language, the best fit synonym word is selected that most closely matches the mouth shape of the first language word, and a mouth shape adjustment script is applied to fine tune the mouth shape of the best fit synonym word.
    Type: Application
    Filed: February 13, 2017
    Publication date: August 16, 2018
    Inventors: Yuan Jin, Cheng Yu Peng, Yin Qian, Xiao Rui Shao, Jian Jun Wang
  • Publication number: 20180225306
    Abstract: Disclosed embodiments provide techniques for suggesting images that can be conveniently included in electronic communication such as social media posts, emails, text messages, and other forms of electronic communication, based on voice input and/or emotion analysis from facial expressions of a user. A speech-to-text process converts a user's spoken utterance to text. Natural language processing performs an entity extraction on the utterance to generate a scenario summary. An image database is queried using the scenario summary and/or emotion analysis based on user facial images. A mapping rule library may be used to perform the image database query. Based on the scenario summary and/or the emotion analysis, images are presented to the user as recommended for including in an electronic communication message such as a social media post, email, or text message.
    Type: Application
    Filed: February 8, 2017
    Publication date: August 9, 2018
    Inventors: Jin Long LL He, Yu Hong YL Li, Xiao Rui Shao, Fei F. Shen, Jian Jun Wang
  • Publication number: 20180191987
    Abstract: Approaches presented herein enable displaying a barrage message. Specifically, one or more objects and location information for each object in a frame of a video are identified. A barrage message to be displayed in the frame of the video is obtained. The barrage message is displayed without covering any object in the frame.
    Type: Application
    Filed: January 4, 2017
    Publication date: July 5, 2018
    Inventors: Xiao Cao Cao, Yu Huang, Yuan Jin, Chengyu Peng, Yin Qian, Xiao Rui Shao, Jian Jun Wang