Patents by Inventor Ce Liu
Ce Liu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12260572Abstract: A method includes determining, based on an image having an initial viewpoint, a depth image, and determining a foreground visibility map including visibility values that are inversely proportional to a depth gradient of the depth image. The method also includes determining, based on the depth image, a background disocclusion mask indicating a likelihood that pixel of the image will be disoccluded by a viewpoint adjustment. The method additionally includes generating, based on the image, the depth image, and the background disocclusion mask, an inpainted image and an inpainted depth image. The method further includes generating, based on the depth image and the inpainted depth image, respectively, a first three-dimensional (3D) representation of the image and a second 3D representation of the inpainted image, and generating a modified image having an adjusted viewpoint by combining the first and second 3D representation based on the foreground visibility map.Type: GrantFiled: August 5, 2021Date of Patent: March 25, 2025Assignee: Google LLCInventors: Varun Jampani, Huiwen Chang, Kyle Sargent, Abhishek Kar, Richard Tucker, Dominik Kaeser, Brian L. Curless, David Salesin, William T. Freeman, Michael Krainin, Ce Liu
-
Patent number: 12236676Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating realistic extensions of images. In one aspect, a method comprises providing an input that comprises a provided image to a generative neural network having a plurality of generative neural network parameters. The generative neural network processes the input in accordance with trained values of the plurality of generative neural network parameters to generate an extended image. The extended image has (i) more rows, more columns, or both than the provided image, and (ii) is predicted to be a realistic extension of the provided image. The generative neural network is trained using an adversarial loss objective function.Type: GrantFiled: July 19, 2019Date of Patent: February 25, 2025Assignee: Google LLCInventors: Mikael Pierre Bonnevie, Aaron Maschinot, Aaron Sarna, Shuchao Bi, Jingbin Wang, Michael Spencer Krainin, Wenchao Tong, Dilip Krishnan, Haifeng Gong, Ce Liu, Hossein Talebi, Raanan Sayag, Piotr Teterwak
-
Patent number: 12190403Abstract: Methods, systems, and computer programs encoded on a computer storage medium, that relate to extracting digital watermarks from images, irrespective of distortions introduced into these images. Methods can include inputting a first data item into a channel encoder that can generate a first encoded data item that is greater in length than the first data item and that (1) includes the input data item and (2) new data this is redundant of the input data item. Based on the first encoded data item and a first image, an encoder model can generate a first encoded image into which the first encoded data is embedded as a digital watermark. A decoder model can decode the first encoded data item to generate a second data, which can be decoded by the channel decoder to generate data that is predicted to be the first data.Type: GrantFiled: January 13, 2020Date of Patent: January 7, 2025Assignee: Google LLCInventors: Ruohan Zhan, Feng Yang, Xiyang Luo, Peyman Milanfar, Huiwen Chang, Ce Liu
-
Publication number: 20240404154Abstract: A multimedia communication system and computer-implemented method for transmitting auxiliary display content to an end-user communication device to be rendered on a display device with a special effect to emphasize an image included in the auxiliary display content, comprising analyzing image data included in an auxiliary display content to detect an object image or a background image, determining a special effect based on the analysis of the image data, applying the special effect to the auxiliary display content to modify display properties for the auxiliary display content such that the object image is emphasized or pops out, and sending the auxiliary display content with modified display properties to the end-user communication device. The special effect can comprise a non-customization special effect, a simple foreground special effect or a selective foreground special effect.Type: ApplicationFiled: August 14, 2024Publication date: December 5, 2024Applicant: Google LLCInventors: Mikaël Bonnevie, Yuanzhen Li, Ce Liu
-
Publication number: 20240332995Abstract: Example batteries, terminals, and charging systems are described. One example battery includes a battery charging port, a battery discharging port, a battery negative port, an overcurrent protection element, a protection integrated circuit, a control switch, and an electrochemical cell. The battery charging port is connected to a positive electrode of the electrochemical cell. The control switch is connected in series between a negative electrode of the electrochemical cell and the battery negative port. The protection integrated circuit is connected in parallel to two ends of the electrochemical cell. The protection integrated circuit is further connected to the control switch so as to send a control signal to the control switch. In addition, the overcurrent protection element is connected in series between the battery discharging port and the positive electrode of the electrochemical cell. The battery provided in the present application has both a charging path and a discharging path.Type: ApplicationFiled: March 8, 2024Publication date: October 3, 2024Inventors: Xinyu LIU, Pinghua WANG, Ce LIU, Yanding LIU, Jinbo MA
-
Patent number: 12086913Abstract: A multimedia communication system and computer-implemented method for transmitting auxiliary display content to an end-user communication device to be rendered on a display device with a special effect to emphasize an image included in the auxiliary display content, comprising a processor and a transmitter. The processor can be arranged to analyze image data included in an auxiliary display content, detect an object image or a background image in the auxiliary display content based on the analysis of the image data, determine a special effect based on the analysis of the image data, and apply the special effect to the auxiliary display content to modify display properties for the auxiliary display content such that the object image is emphasized or pops-out. The transmitter can be arranged to send the auxiliary display content with modified display properties to an end-user communication device.Type: GrantFiled: October 6, 2022Date of Patent: September 10, 2024Inventors: Mikaël Bonnevie, Yuanzhen Li, Ce Liu
-
Publication number: 20240266841Abstract: A terminal and a fast charging method includes sending, by the terminal, instruction information to a charger connected to the terminal in order to instruct the charger to adjust an output voltage and an output current; converting, by the terminal, the output voltage of the charger into 1/K times the output voltage; and converting the output current of the charger into K times the output current such that a charging circuit between two sides of a battery charges the battery with the 1/K times the output voltage and the K times the output current, where K is a conversion coefficient of a conversion circuit with a fixed conversion ratio in the terminal and is a constant value, and K is any real number greater than one.Type: ApplicationFiled: April 18, 2024Publication date: August 8, 2024Inventors: Xujun Liu, Ce Liu, Yanding Liu, Jinbo Ma, Pinghua Wang
-
Publication number: 20240249422Abstract: A method includes determining, based on an image having an initial viewpoint, a depth image, and determining a foreground visibility map including visibility values that are inversely proportional to a depth gradient of the depth image. The method also includes determining, based on the depth image, a background disocclusion mask indicating a likelihood that pixel of the image will be disoccluded by a viewpoint adjustment. The method additionally includes generating, based on the image, the depth image, and the background disocclusion mask, an inpainted image and an inpainted depth image. The method further includes generating, based on the depth image and the inpainted depth image, respectively, a first three-dimensional (3D) representation of the image and a second 3D representation of the inpainted image, and generating a modified image having an adjusted viewpoint by combining the first and second 3D representation based on the foreground visibility map.Type: ApplicationFiled: August 5, 2021Publication date: July 25, 2024Inventors: Varun Jampani, Huiwen Chang, Kyle Sargent, Abhishek Kar, Richard Tucker, Dominik Kaeser, Brian L. Curless, David Salesin, William T. Freeman, Michael Krainin, Ce Liu
-
Patent number: 11990774Abstract: A terminal and a fast charging method to fast charge the terminal, where the method includes: sending, by the terminal, instruction information to a charger connected to the terminal in order to instruct the charger to adjust an output voltage and an output current; converting, by the terminal, the output voltage of the charger into 1/K times the output voltage; and converting the output current of the charger into K times the output current such that a charging circuit between two sides of a battery charges the battery with the 1/K times the output voltage and the K times the output current, where K is a conversion coefficient of a conversion circuit with a fixed conversion ratio in the terminal and is a constant value, and K is any real number greater than one.Type: GrantFiled: January 18, 2023Date of Patent: May 21, 2024Assignee: HUAWEI TECHNOLOGIES CO., LTD.Inventors: Xujun Liu, Ce Liu, Yanding Liu, Jinbo Ma, Pinghua Wang
-
Patent number: 11978225Abstract: A method includes obtaining a reference image and a target image each representing an environment containing moving features and static features. The method also includes determining an object mask configured to mask out the moving features and preserves the static features in the target image. The method additionally includes determining, based on motion parallax between the reference image and the target image, a static depth image representing depth values of the static features in the target image. The method further includes generating, by way of a machine learning model, a dynamic depth image representing depth values of both the static features and the moving features in the target image. The model is trained to generate the dynamic depth image by determining depth values of at least the moving features based on the target image, the object mask, and the static depth image.Type: GrantFiled: April 17, 2023Date of Patent: May 7, 2024Assignee: Google LLCInventors: Tali Dekel, Forrester Cole, Ce Liu, William Freeman, Richard Tucker, Noah Snavely, Zhengqi Li
-
Patent number: 11962176Abstract: Example devices are described. One example device includes a battery. The battery includes a battery charging port, a battery discharging port, a battery negative port, a protection integrated circuit, a control switch, and an electrochemical cell. The battery charging port and the battery discharging port are ports independent of each other. The battery charging port is connected to a first electrode of the electrochemical cell, and a second electrode of the electrochemical cell is connected to a first end of the control switch, and a second end of the control switch is connected to the battery negative port. The protection integrated circuit is connected in parallel to electrodes of the electrochemical cell, and the protection integrated circuit is further connected to a third end of the control switch. The battery discharging port is connected to the first electrode of the electrochemical cell.Type: GrantFiled: August 3, 2022Date of Patent: April 16, 2024Assignee: Huawei Technologies Co., Ltd.Inventors: Xinyu Liu, Pinghua Wang, Ce Liu, Yanding Liu, Jinbo Ma
-
Publication number: 20240022760Abstract: Example aspects of the present disclosure are directed to systems and methods which feature a machine-learned video super-resolution (VSR) model which has been trained using a bi-directional training approach. In particular, the present disclosure provides a compression-informed (e.g., compression-aware) super-resolution model that can perform well on real-world videos with different levels of compression. Specifically, example models described herein can include three modules to robustly restore the missing information caused by video compression. First, a bi-directional recurrent module can be used to reduce the accumulated warping error from the random locations of the intra-frame from compressed video frames. Second, a detail-aware flow estimation module can be added to enable recovery of high resolution (HR) flow from compressed low resolution (LR) frames. Finally, a Laplacian enhancement module can add high-frequency information to the warped HR frames washed out by video encoding.Type: ApplicationFiled: August 5, 2021Publication date: January 18, 2024Inventors: Yinxiao Li, Peyman Milanfar, Feng Yang, Ce Liu, Ming-Hsuan Yang, Pengchong Jin
-
Publication number: 20240020788Abstract: Systems and methods of the present disclosure are directed to a computing system. The computing system can obtain a message vector and video data comprising a plurality of video frames. The computing system can process the input video with a transformation portion of a machine-learned watermark encoding model to obtain a three-dimensional feature encoding of the input video. The computing system can process the three-dimensional feature encoding of the input video and the message vector with an embedding portion of the machine-learned watermark encoding model to obtain spatial-temporal watermark encoding data descriptive of the message vector. The computing system can generate encoded video data comprising a plurality of encoded video frames, wherein at least one of the plurality of encoded video frames includes the spatial-temporal watermark encoding data.Type: ApplicationFiled: March 24, 2021Publication date: January 18, 2024Inventors: Xiyang Luo, Feng Yang, Ce Liu, Huiwen Chang, Peyman Milanfar, Yinxiao Li
-
Publication number: 20240013497Abstract: A computing system and method can be used to render a 3D shape from one or more images. In particular, the present disclosure provides a general pipeline for learning articulated shape reconstruction from images (LASR). The pipeline can reconstruct rigid or nonrigid 3D shapes. In particular, the pipeline can automatically decompose non-rigidly deforming shapes into rigid motions near rigid-bones. This pipeline incorporates an analysis-by-synthesis strategy and forward-renders silhouette, optical flow, and color images which can be compared against the video observations to adjust the internal parameters of the model. By inverting a rendering pipeline and incorporating optical flow, the pipeline can recover a mesh of a 3D model from the one or more images input by a user.Type: ApplicationFiled: December 21, 2020Publication date: January 11, 2024Inventors: Deqing Sun, Varun Jampani, Gengshan Yang, Daniel Vlasic, Huiwen Chang, Forrester H. Cole, Ce Liu, William Tafel Freeman
-
METHOD OF OPTIMIZING A DESIGN OF A STRUCTURE BY CONSIDERING CENTRIFUGAL LOADS AND STRESS CONSTRAINTS
Publication number: 20230409767Abstract: Disclosed is design optimization method of the structure considering centrifugal loads and stress constraints. Compared with the prior art, this application improves the method for obtaining the relaxation coefficient c, including the calculation of the second predicted maximum stress based on the predicted stress method from steps S9.1 to S9.8. The influence of the existence of jagged boundaries and gray densities on the calculation of the structural stress field is reduced. The most important thing is to decide whether to use linear penalty or nonlinear penalty for the elastic modulus of each element according to the ratio of the number of elements with design variables less than 0.1 and greater than 0.9 to the total number of elements. Introducing the predicted maximum stress can make full use of the allowable stress of materials, improve the quality of optimization design, and obtain a design scheme with a lighter mass.Type: ApplicationFiled: February 14, 2023Publication date: December 21, 2023Applicant: XIAMEN UNIVERSITYInventors: Cheng YAN, Ce LIU, He LIU, Yuxin LIN, Cunfu WANG, Zeyong YIN -
Publication number: 20230275393Abstract: A laser emitting apparatus includes a detection and control system, a pump source, a first reflecting mirror group, a gain medium, and a beam deflection system on an optical path. The gain medium is pumped by the pump source to emit fluorescence, and is stimulated by resonance, between the first reflecting mirror group and a laser receiving apparatus, of the fluorescence to emit laser light. The beam deflection system emits the fluorescence or the laser light emitted by the gain medium, and emits the fluorescence or the laser light reflected by the laser receiving apparatus into the gain medium. The detection and control system adjusts the beam deflection system to preset emission angles, detects light intensities of the fluorescence or the laser light, and a light spot position of the laser light on the detection and control system, and adjusts the emission angle based on the light spot position.Type: ApplicationFiled: May 1, 2023Publication date: August 31, 2023Inventors: Ce Liu, Zefeng Lu, Mingqiang Wang, Yanding Liu
-
Publication number: 20230260145Abstract: A method includes obtaining a reference image and a target image each representing an environment containing moving features and static features. The method also includes determining an object mask configured to mask out the moving features and preserves the static features in the target image. The method additionally includes determining, based on motion parallax between the reference image and the target image, a static depth image representing depth values of the static features in the target image. The method further includes generating, by way of a machine learning model, a dynamic depth image representing depth values of both the static features and the moving features in the target image. The model is trained to generate the dynamic depth image by determining depth values of at least the moving features based on the target image, the object mask, and the static depth image.Type: ApplicationFiled: April 17, 2023Publication date: August 17, 2023Inventors: Tali Dekel, Forrester Cole, Ce Liu, William Freeman, Richard Tucker, Noah Snavely, Zhengqi Li
-
Patent number: 11663733Abstract: A method includes obtaining a reference image and a target image each representing an environment containing moving features and static features. The method also includes determining an object mask configured to mask out the moving features and preserves the static features in the target image. The method additionally includes determining, based on motion parallax between the reference image and the target image, a static depth image representing depth values of the static features in the target image. The method further includes generating, by way of a machine learning model, a dynamic depth image representing depth values of both the static features and the moving features in the target image. The model is trained to generate the dynamic depth image by determining depth values of at least the moving features based on the target image, the object mask, and the static depth image.Type: GrantFiled: March 23, 2022Date of Patent: May 30, 2023Assignee: Google LLCInventors: Tali Dekel, Forrester Cole, Ce Liu, William Freeman, Richard Tucker, Noah Snavely, Zhengqi Li
-
Publication number: 20230155392Abstract: A terminal and a fast charging method to fast charge the terminal, where the method includes sending, by the terminal, instruction information to a charger connected to the terminal in order to instruct the charger to adjust an output voltage and an output current, converting, by the terminal, the output voltage of the charger into 1/K times the output voltage, and converting the output current of the charger into K times the output current such that a charging circuit between two sides of a battery charges the battery with the 1/K times the output voltage and the K times the output current, where K is a conversion coefficient of a conversion circuit with a fixed conversion ratio in the terminal and is a constant value, and K is any real number greater than one.Type: ApplicationFiled: January 18, 2023Publication date: May 18, 2023Inventors: Xujun Liu, Ce Liu, Yanding Liu, Jinbo Ma, Pinghua Wang
-
Publication number: 20230153629Abstract: The present disclosure provides an improved training methodology that enables supervised contrastive learning to be simultaneously performed across multiple positive and negative training examples. In particular, example aspects of the present disclosure are directed to an improved, supervised version of the batch contrastive loss, which has been shown to be very effective at learning powerful representations in the self-supervised setting Thus, the proposed techniques adapt contrastive learning to the fully supervised setting and also enable learning to occur simultaneously across multiple positive examples.Type: ApplicationFiled: April 12, 2021Publication date: May 18, 2023Inventors: Dilip Krishnan, Prannay Khosla, Piotr Teterwak, Aaron Yehuda Sarna, Aaron Joseph Maschinot, Ce Liu, Philip John Isola, Yonglong Tian, Chen Wang