Patents by Inventor Yun-Ta Tsai

Yun-Ta Tsai has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12136203
    Abstract: Apparatus and methods related to applying lighting models to images of objects are provided. A neural network can be trained to apply a lighting model to an input image. The training of the neural network can utilize confidence learning that is based on light predictions and prediction confidence values associated with lighting of the input image. A computing device can receive an input image of an object and data about a particular lighting model to be applied to the input image. The computing device can determine an output image of the object by using the trained neural network to apply the particular lighting model to the input image of the object.
    Type: Grant
    Filed: August 22, 2023
    Date of Patent: November 5, 2024
    Assignee: Google LLC
    Inventors: Tiancheng Sun, Yun-Ta Tsai, Jonathan Barron
  • Patent number: 12094054
    Abstract: Examples relate to implementations of a neural light transport. A computing system may obtain data indicative of a plurality of UV texture maps and a geometry of an object. Each UV texture map depicts the object from a perspective of a plurality of perspectives. The computing system may train a neural network to learn a light transport function using the data. The light transport function may be a continuous function that specifies how light interacts with the object when the object is viewed from the plurality of perspectives. The computing system may generate an output UV texture map that depicts the object from a synthesized perspective based on an application of the light transport function by the trained neural network.
    Type: Grant
    Filed: May 4, 2020
    Date of Patent: September 17, 2024
    Assignee: Google LLC
    Inventors: Yun-Ta Tsai, Xiuming Zhang, Jonathan T. Barron, Sean Fanello, Tiancheng Sun, Tianfan Xue
  • Publication number: 20230406356
    Abstract: Systems and methods for fail-safe corrective actions based on vision information for autonomous driving. An example method is implemented by a processor system included in a vehicle, with the method comprising obtaining images from image sensors positioned about the vehicle. Visibility information is determined for at least a portion of the images. Adjustment of operation of an autonomous vehicle is caused based on the visibility information.
    Type: Application
    Filed: May 19, 2023
    Publication date: December 21, 2023
    Inventors: Uma Balakrishnan, Daniel Hunter, Akash Chaurasia, Yun-Ta Tsai, Akshay Vijay Phatak
  • Publication number: 20230401681
    Abstract: Apparatus and methods related to applying lighting models to images of objects are provided. A neural network can be trained to apply a lighting model to an input image. The training of the neural network can utilize confidence learning that is based on light predictions and prediction confidence values associated with lighting of the input image. A computing device can receive an input image of an object and data about a particular lighting model to be applied to the input image. The computing device can determine an output image of the object by using the trained neural network to apply the particular lighting model to the input image of the object.
    Type: Application
    Filed: August 22, 2023
    Publication date: December 14, 2023
    Inventors: Tiancheng Sun, Yun-Ta Tsai, Jonathan Barron
  • Publication number: 20230360182
    Abstract: Apparatus and methods related to applying lighting models to images of objects are provided. An example method includes applying a geometry model to an input image to determine a surface orientation map indicative of a distribution of lighting on an object based on a surface geometry. The method further includes applying an environmental light estimation model to the input image to determine a direction of synthetic lighting to be applied to the input image. The method also includes applying, based on the surface orientation map and the direction of synthetic lighting, a light energy model to determine a quotient image indicative of an amount of light energy to be applied to each pixel of the input image. The method additionally includes enhancing, based on the quotient image, a portion of the input image. One or more neural networks can be trained to perform one or more of the aforementioned aspects.
    Type: Application
    Filed: May 17, 2021
    Publication date: November 9, 2023
    Inventors: Sean Ryan Francesco Fanello, Yun-Ta Tsai, Rohit Kumar Pandey, Paul Debevec, Michael Milne, Chloe LeGendre, Jonathan Tilton Barron, Christoph Rhemann, Sofien Bouaziz, Navin Padman Sarma
  • Publication number: 20230351560
    Abstract: Systems and methods described herein may relate to potential methods of training a machine learning model to be implemented on a mobile computing device configured to capture, adjust, and/or store image frames. An example method includes supplying a first image frame of a subject in a setting lit within a first lighting environment and supplying a second image frame of the subject lit within a second lighting environment. The method further includes determining a mask. Additionally, the method includes combining the first image frame and the second image frame according to the mask to generate a synthetic image and assigning a score to the synthetic image. The method also includes training a machine learning model based on the assigned score to adjust a captured image based on the synthetic image.
    Type: Application
    Filed: December 23, 2019
    Publication date: November 2, 2023
    Inventors: David Jacobs, Yun-Ta Tsai, Jonathan T. Barron, Xuaner Zhang
  • Patent number: 11776095
    Abstract: Apparatus and methods related to applying lighting models to images of objects are provided. A neural network can be trained to apply a lighting model to an input image. The training of the neural network can utilize confidence learning that is based on light predictions and prediction confidence values associated with lighting of the input image. A computing device can receive an input image of an object and data about a particular lighting model to be applied to the input image. The computing device can determine an output image of the object by using the trained neural network to apply the particular lighting model to the input image of the object.
    Type: Grant
    Filed: April 1, 2019
    Date of Patent: October 3, 2023
    Assignee: Google LLC
    Inventors: Tiancheng Sun, Yun-ta Tsai, Jonathan Barron
  • Patent number: 11757034
    Abstract: A high-voltage device includes a first frame-like isolation and a second frame-like isolation separated from each other, a first frame-like gate structure covering the first frame-like isolation, a second frame-like gate structure covering the second frame-like isolation, a first drain region enclosed by the first frame-like isolation, a second drain region enclosed by the second frame-like isolation, a first frame-like source region surrounding the first frame-like gate structure, a second frame-like source region surrounding the second frame-like gate structure, a first doped region surrounding the first and second frame-like gate structures, and a second doped region disposed between the first and second frame-like gate structures. The first and second drain regions, and the first and second frame-like source regions include a first conductivity type. The first and the second doped region include a second conductivity type.
    Type: Grant
    Filed: April 27, 2022
    Date of Patent: September 12, 2023
    Assignee: TAIWAN SEMICONDUCTOR MANUFACTURING COMPANY LTD.
    Inventors: Hung-Sen Wang, Yun-Ta Tsai, Ruey-Hsin Liu, Shih-Fen Huang, Ho-Chun Liou
  • Publication number: 20220327769
    Abstract: Examples relate to implementations of a neural light transport. A computing system may obtain data indicative of a plurality of UV texture maps and a geometry of an object. Each UV texture map depicts the object from a perspective of a plurality of perspectives. The computing system may train a neural network to learn a light transport function using the data. The light transport function may be a continuous function that specifies how light interacts with the object when the object is viewed from the plurality of perspectives. The computing system may generate an output UV texture map that depicts the object from a synthesized perspective based on an application of the light transport function by the trained neural network.
    Type: Application
    Filed: May 4, 2020
    Publication date: October 13, 2022
    Inventors: Yun-Ta TSAI, Xiuming ZHANG, Jonathan T. BARRON, Sean FANELLO, Tiancheng SUN, Tianfan XUE
  • Publication number: 20220254923
    Abstract: A high-voltage device includes a first frame-like isolation and a second frame-like isolation separated from each other, a first frame-like gate structure covering the first frame-like isolation, a second frame-like gate structure covering the second frame-like isolation, a first drain region enclosed by the first frame-like isolation, a second drain region enclosed by the second frame-like isolation, a first frame-like source region surrounding the first frame-like gate structure, a second frame-like source region surrounding the second frame-like gate structure, a first doped region surrounding the first and second frame-like gate structures, and a second doped region disposed between the first and second frame-like gate structures. The first and second drain regions, and the first and second frame-like source regions include a first conductivity type. The first and the second doped region include a second conductivity type.
    Type: Application
    Filed: April 27, 2022
    Publication date: August 11, 2022
    Inventors: HUNG-SEN WANG, YUN-TA TSAI, RUEY-HSIN LIU, SHIH-FEN HUANG, HO-CHUN LIOU
  • Patent number: 11322609
    Abstract: A high-voltage device includes a substrate, a first well region disposed in the substrate, at least a first isolation, a frame-like gate structure over the first well region and covering a portion of the first isolation, a drain region in the first well region and separated from the frame-like gate structure by the first isolation, and a source region separated from the drain region by the first isolation and the frame-like gate structure. The first well region, the drain region and the source region include a first conductivity type, and the substrate includes a second conductivity type. The first conductivity type and the second conductivity type are complementary to each other.
    Type: Grant
    Filed: June 19, 2020
    Date of Patent: May 3, 2022
    Assignee: TAIWAN SEMICONDUCTOR MANUFACTURING COMPANY LTD.
    Inventors: Hung-Sen Wang, Yun-Ta Tsai, Ruey-Hsin Liu, Shih-Fen Huang, Ho-Chun Liou
  • Publication number: 20210264576
    Abstract: Apparatus and methods related to applying lighting models to images of objects are provided. A neural network can be trained to apply a lighting model to an input image. The training of the neural network can utilize confidence learning that is based on light predictions and prediction confidence values associated with lighting of the input image. A computing device can receive an input image of an object and data about a particular lighting model to be applied to the input image. The computing device can determine an output image of the object by using the trained neural network to apply the particular lighting model to the input image of the object.
    Type: Application
    Filed: April 1, 2019
    Publication date: August 26, 2021
    Inventors: Tiancheng SUN, Yun-ta TSAI, Jonathan BARRON
  • Publication number: 20210167205
    Abstract: A high-voltage device includes a substrate, at least a first isolation in the substrate, a first well region, a frame-like gate structure over the first well region and covering a portion of the first isolation, a drain region in the first well region and separated from the frame-like gate structure by the first isolation, and a source region separated from the drain region by the first isolation and the frame-like gate structure. The first well region, the drain region and the source region include a first conductivity type, and the substrate includes a second conductivity type. The first conductivity type and the second conductivity type are complementary to each other.
    Type: Application
    Filed: June 19, 2020
    Publication date: June 3, 2021
    Inventors: HUNG-SEN WANG, YUN-TA TSAI, RUEY-HSIN LIU, SHIH-FEN HUANG, HO-CHUN LIOU
  • Patent number: 10949958
    Abstract: Methods for white-balancing images are provided. These methods include determining, for an input image, a chrominance histogram for the pixels of the input image. The determined histogram is a toroidal chrominance histogram, with an underlying, toroidal chrominance space that corresponds to a wrapped version, of a standard flat chrominance space. The toroidal chrominance histogram is- then convolved with a fitter to generate a two-dimensional heat map that is then used to determine art estimated chrominance of i|lummaiioB present id the input image; This can include fitting a bivariate von Mises distribution, or some other circular and/or toroidal, probability distribution, to the determined two-dimensional heat map. These methods for estimating illumination chrominance values for input images have reduced computational costs and increased speed relative to other methods for determining image illuminant chrominance values.
    Type: Grant
    Filed: November 14, 2017
    Date of Patent: March 16, 2021
    Assignee: Google LLC
    Inventors: Jonathan Barron, Yun-Ta Tsai
  • Publication number: 20200051225
    Abstract: Methods for white-balancing images are provided. These methods include determining, for an input image, a chrominance histogram for the pixels of the input image. The determined histogram is a toroidal chrominance histogram, with an underlying, toroidal chrominance space that corresponds to a wrapped version, of a standard flat chrominance space. The toroidal chrominance histogram is- then convolved with a fitter to generate a two-dimensional heat map that is then used to determine art estimated chrominance of i|lummaiioB present id the input image; This can include fitting a bivariate von Mises distribution, or some other circular and/or toroidal, probability distribution, to the determined two-dimensional heat map.
    Type: Application
    Filed: November 14, 2017
    Publication date: February 13, 2020
    Inventors: Jonathan Barron, Yun-Ta Tsai
  • Patent number: 10237527
    Abstract: A computing device may obtain an input image. The input image may have a white point represented by chrominance values that define white color in the input image. Possibly based on colors of the input image, the computing device may generate a two-dimensional chrominance histogram of the input image. The computing device may convolve the two-dimensional chrominance histogram with a filter to create a two-dimensional heat map. Entries in the two-dimensional heat map may represent respective estimates of how close respective tints corresponding to the respective entries are to the white point of the input image. The computing device may select an entry in the two-dimensional heat map that represents a particular value that is within a threshold of a maximum value in the heat map, and based on the selected entry, tint the input image to form an output image.
    Type: Grant
    Filed: August 23, 2018
    Date of Patent: March 19, 2019
    Assignee: Google LLC
    Inventors: Jonathan T. Barron, Yun-Ta Tsai
  • Publication number: 20180367774
    Abstract: A computing device may obtain an input image. The input image may have a white point represented by chrominance values that define white color in the input image. Possibly based on colors of the input image, the computing device may generate a two-dimensional chrominance histogram of the input image. The computing device may convolve the two-dimensional chrominance histogram with a filter to create a two-dimensional heat map. Entries in the two-dimensional heat map may represent respective estimates of how close respective tints corresponding to the respective entries are to the white point of the input image. The computing device may select an entry in the two-dimensional heat map that represents a particular value that is within a threshold of a maximum value in the heat map, and based on the selected entry, tint the input image to form an output image.
    Type: Application
    Filed: August 23, 2018
    Publication date: December 20, 2018
    Inventors: Jonathan T. Barron, Yun-Ta Tsai
  • Patent number: 10091479
    Abstract: A computing device may obtain an input image. The input image may have a white point represented by chrominance values that define white color in the input image. Possibly based on colors of the input image, the computing device may generate a two-dimensional chrominance histogram of the input image. The computing device may convolve the two-dimensional chrominance histogram with a filter to create a two-dimensional heat map. Entries in the two-dimensional heat map may represent respective estimates of how close respective tints corresponding to the respective entries are to the white point of the input image. The computing device may select an entry in the two-dimensional heat map that represents a particular value that is within a threshold of a maximum value in the heat map, and based on the selected entry, tint the input image to form an output image.
    Type: Grant
    Filed: September 13, 2017
    Date of Patent: October 2, 2018
    Assignee: Google LLC
    Inventors: Jonathan T. Barron, Yun-Ta Tsai
  • Patent number: 9934153
    Abstract: A patch memory system for accessing patches from a memory is disclosed. A patch is an abstraction that refers to a contiguous, array of data that is a subset of an N-dimensional array of data. The patch memory system includes a tile cache, and is configured to fetch data associated with a patch by determining one or more tiles associated with an N-dimensional array of data corresponding to the patch, and loading data for the one or more tiles from the memory into the tile cache. The N-dimensional array of data may be a two-dimensional (2D) digital image comprising a plurality of pixels. A patch of the 2D digital image may refer to a 2D subset of the image.
    Type: Grant
    Filed: June 30, 2015
    Date of Patent: April 3, 2018
    Assignee: NVIDIA Corporation
    Inventors: Jason Lavar Clemons, Chih-Chi Cheng, Daniel Robert Johnson, Stephen William Keckler, Iuri Frosio, Yun-Ta Tsai
  • Publication number: 20180007337
    Abstract: A computing device may obtain an input image. The input image may have a white point represented by chrominance values that define white color in the input image. Possibly based on colors of the input image, the computing device may generate a two-dimensional chrominance histogram of the input image. The computing device may convolve the two-dimensional chrominance histogram with a filter to create a two-dimensional heat map. Entries in the two-dimensional heat map may represent respective estimates of how close respective tints corresponding to the respective entries are to the white point of the input image. The computing device may select an entry in the two-dimensional heat map that represents a particular value that is within a threshold of a maximum value in the heat map, and based on the selected entry, tint the input image to form an output image.
    Type: Application
    Filed: September 13, 2017
    Publication date: January 4, 2018
    Inventors: Jonathan T. Barron, Yun-Ta Tsai