Patents by Inventor Sibo Zhang

Sibo Zhang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11657668
    Abstract: The present disclosure provides a driving device, a bucket and a vending machine. The driving device comprises a base, a motor arranged on the base, a transmission mechanism in transmission connection with the output shaft of the motor and a power output wheel in transmission connection with the transmission mechanism; the transmission mechanism is configured to drive the power output wheel to rotate and to move from a first position to a second position when the output shaft of the motor rotates in a first preset direction; the transmission mechanism is also configured to drive the power output wheel to move from the second position to the first position when the output shaft of the motor rotates in a second preset direction; wherein the first preset direction is opposite to the second preset direction.
    Type: Grant
    Filed: September 21, 2018
    Date of Patent: May 23, 2023
    Assignee: Shandong New Beiyang Information Technology Co., Ltd.
    Inventors: Kai Liu, Hongze Wei, Fengbo Xu, Sibo Zhang
  • Publication number: 20230072434
    Abstract: Presented herein are embodiments of a vision-based object perception system for activity analysis, safety monitoring, or both. Embodiments of the perception subsystem detect multi-class objects (e.g., construction machines and humans) in real-time while estimating the poses and actions of the detected objects. Safety monitoring embodiments and object activity analysis embodiments may be based on the perception result. To evaluate the performance of embodiments, a dataset was collected including multi-class of objects in different lighting conditions with human annotations. Experimental results show that the proposed action recognition approach outperforms the state-of-the-art approaches on top-1 accuracy by about 5.18%.
    Type: Application
    Filed: July 26, 2022
    Publication date: March 9, 2023
    Applicant: Baidu USA LLC
    Inventors: Sibo ZHANG, Liangjun ZHANG
  • Patent number: 11587548
    Abstract: Presented herein are novel approaches to synthesize video of the speech from text. In a training phase, embodiments build a phoneme-pose dictionary and train a generative neural network model using a generative adversarial network (GAN) to generate video from interpolated phoneme poses. In deployment, the trained generative neural network in conjunction with the phoneme-pose dictionary convert an input text into a video of a person speaking the words of the input text. Compared to audio-driven video generation approaches, the embodiments herein have a number of advantages: 1) they only need a fraction of the training data used by an audio-driven approach; 2) they are more flexible and not subject to vulnerability due to speaker variation; and 3) they significantly reduce the preprocessing, training, and inference times.
    Type: Grant
    Filed: April 2, 2021
    Date of Patent: February 21, 2023
    Assignee: Baidu USA LLC
    Inventors: Sibo Zhang, Jiahong Yuan, Miao Liao, Liangjun Zhang
  • Patent number: 11514634
    Abstract: Presented herein are novel embodiments for converting a given speech audio or text into a photo-realistic speaking video of a person with synchronized, realistic, and expressive body dynamics. In one or more embodiments, 3D skeleton movements are generated from the audio sequence using a recurrent neural network, and an output video is synthesized via a conditional generative adversarial network. To make movements realistic and expressive, the knowledge of an articulated 3D human skeleton and a learned dictionary of personal speech iconic gestures may be embedded into the generation process in both learning and testing pipelines. The former prevents the generation of unreasonable body distortion, while the later helps the model quickly learn meaningful body movement with a few videos. To produce photo-realistic and high-resolution video with motion details, a part-attention mechanism is inserted in the conditional GAN, where each detailed part is automatically zoomed in to have their own discriminators.
    Type: Grant
    Filed: June 12, 2020
    Date of Patent: November 29, 2022
    Assignees: Baidu USA LLC, Baidu.com Times Technology (Beijing) Co., Ltd.
    Inventors: Miao Liao, Sibo Zhang, Peng Wang, Ruigang Yang
  • Patent number: 11282164
    Abstract: Systems and methods of video inpainting for autonomous driving are disclosed. For example, the method stitches a multiplicity of depth frames into a 3D map, where one or more objects in the depth frames have previously been removed. The method further projects the 3D map onto a first image frame to generate a corresponding depth map, where the first image frame includes a target inpainting region. For each target pixel within the target inpainting region of the first image frame, based on the corresponding depth map, the method further maps the target pixel within the target inpainting region of the first image frame to a candidate pixel in a second image frame. The method further determines a candidate color to fill the target pixel. The method further performs Poisson image editing on the first image frame to achieve color consistency at a boundary and between inside and outside of the target inpainting region of the first image frame.
    Type: Grant
    Filed: May 26, 2020
    Date of Patent: March 22, 2022
    Assignees: BAIDU USA LLC, BAIDU.COM TIMES TECHNOLOGY (BEIJING) CO., LTD.
    Inventors: Miao Liao, Feixiang Lu, Dingfu Zhou, Sibo Zhang, Ruigang Yang
  • Publication number: 20210390945
    Abstract: Presented herein are novel approaches to synthesize video of the speech from text. In a training phase, embodiments build a phoneme-pose dictionary and train a generative neural network model using a generative adversarial network (GAN) to generate video from interpolated phoneme poses. In deployment, the trained generative neural network in conjunction with the phoneme-pose dictionary convert an input text into a video of a person speaking the words of the input text. Compared to audio-driven video generation approaches, the embodiments herein have a number of advantages: 1) they only need a fraction of the training data used by an audio-driven approach; 2) they are more flexible and not subject to vulnerability due to speaker variation; and 3) they significantly reduce the preprocessing, training, and inference times.
    Type: Application
    Filed: April 2, 2021
    Publication date: December 16, 2021
    Applicant: Baidu USA LLC
    Inventors: Sibo ZHANG, Jiahong YUAN, Miao LIAO, Liangjun ZHANG
  • Publication number: 20210390748
    Abstract: Presented herein are novel embodiments for converting a given speech audio or text into a photo-realistic speaking video of a person with synchronized, realistic, and expressive body dynamics. In one or more embodiments, 3D skeleton movements are generated from the audio sequence using a recurrent neural network, and an output video is synthesized via a conditional generative adversarial network. To make movements realistic and expressive, the knowledge of an articulated 3D human skeleton and a learned dictionary of personal speech iconic gestures may be embedded into the generation process in both learning and testing pipelines. The former prevents the generation of unreasonable body distortion, while the later helps the model quickly learn meaningful body movement with a few videos. To produce photo-realistic and high-resolution video with motion details, a part-attention mechanism is inserted in the conditional GAN, where each detailed part is automatically zoomed in to have their own discriminators.
    Type: Application
    Filed: June 12, 2020
    Publication date: December 16, 2021
    Applicants: Baidu USA LLC, Baidu.com Times Technology (Beijing) Co., Ltd.
    Inventors: Miao LIAO, Sibo ZHANG, Peng WANG, Ruigang YANG
  • Publication number: 20210374904
    Abstract: Systems and methods of video inpainting for autonomous driving are disclosed. For example, the method stitches a multiplicity of depth frames into a 3D map, where one or more objects in the depth frames have previously been removed. The method further projects the 3D map onto a first image frame to generate a corresponding depth map, where the first image frame includes a target inpainting region. For each target pixel within the target inpainting region of the first image frame, based on the corresponding depth map, the method further maps the target pixel within the target inpainting region of the first image frame to a candidate pixel in a second image frame. The method further determines a candidate color to fill the target pixel. The method further performs Poisson image editing on the first image frame to achieve color consistency at a boundary and between inside and outside of the target inpainting region of the first image frame.
    Type: Application
    Filed: May 26, 2020
    Publication date: December 2, 2021
    Inventors: Miao LIAO, Feixiang LU, Dingfu ZHOU, Sibo ZHANG, Ruigang YANG
  • Publication number: 20200334940
    Abstract: The present disclosure provides a driving device, a bucket and a vending machine. The driving device comprises a base, a motor arranged on the base, a transmission mechanism in transmission connection with the output shaft of the motor and a power output wheel in transmission connection with the transmission mechanism; the transmission mechanism is configured to drive the power output wheel to rotate and to move from a first position to a second position when the output shaft of the motor rotates in a first preset direction; the transmission mechanism is also configured to drive the power output wheel to move from the second position to the first position when the output shaft of the motor rotates in a second preset direction; wherein the first preset direction is opposite to the second preset direction.
    Type: Application
    Filed: September 21, 2018
    Publication date: October 22, 2020
    Applicant: Shandong New Beiyang Information Technology Co., Ltd.
    Inventors: Kai LIU, Hongze WEI, Fengbo XU, Sibo ZHANG
  • Patent number: 9387306
    Abstract: An intravenous catheter securement device comprises of an intravenous catheter board stabilizer that conforms to patients' bodies and an adjustable elastic sleeve with a hole for catheter insertion, with two overlying flaps for catheter securement. The intravenous catheter board base has holes on either side, one side for connection of the elastic sleeve, and the other side provides a fastening location for elastic bands attached to the sleeve for tightness adjustment. An embodiment of the invention involving the intravenous board is displayed separately as an alternative innovation. This device is comprised of a simple form fitting elastic sleeve having a catheter opening with the intent of applying a removable adhesive to the sleeve itself over the catheter for securement purposes. These embodiments establish a simple, standardized, and safe method of securing intravenous catheters sans adhesive material in contact with the epidermis.
    Type: Grant
    Filed: May 6, 2014
    Date of Patent: July 12, 2016
    Inventors: Andrew Eric Andreae, Lena Mona Badr, James Andrew Bonaffini, Benjamin Ray Campbell, Darian Anthony Edwards, Ilya Gurin, Angela Leslie-Anne Jividen, Lydia An Luu, John Christian McMichael, Matthew Thomas Rhoads, Zi Ye, Sibo Zhang
  • Publication number: 20140350474
    Abstract: An intravenous catheter securement device comprises of an intravenous catheter board stabilizer that conforms to patients' bodies and an adjustable elastic sleeve with a hole for catheter insertion, with two overlying flaps for catheter securement. The intravenous catheter hoard base has holes on either side, one side for connection of the elastic sleeve, and the other side provides a fastening location for elastic bands attached to the sleeve for tightness adjustment. An embodiment of the invention involving the intravenous board is displayed separately as an alternative innovation. This device is comprised of a simple form fitting elastic sleeve having a catheter opening with the intent of applying a removable adhesive to the sleeve itself over the catheter for securement purposes. These embodiments establish a simple, standardized, and safe method of securing intravenous catheters sans adhesive material in contact with the epidermis.
    Type: Application
    Filed: May 6, 2014
    Publication date: November 27, 2014
    Inventors: Andrew Eric Andreae, Angela Leslie-Anne Jividen, Benjamin Ray Campbell, Darian Anthony Edwards, lIya Gurin, James Andrew Bonaffini, John Christian McMichael, Lena Mona Badr, Lydia An Luu, Matthew Thomas Rhoads, Sibo Zhang, Zi Ye