Patents by Inventor Bin Ni

Bin Ni has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20220417567
    Abstract: Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods automatically analyze a live streaming media file, and identify portions of the media that are highlights. The content classified as a highlight can be shared across social media platforms, and indexed for searching respective to attributes of the video content. The streaming and highlight media content is renderable in a novel, modified video player that enables variable playback speeds for how content is classified, and enables on-demand selections of specific content portions and adjustable rendering displays during streaming.
    Type: Application
    Filed: August 30, 2022
    Publication date: December 29, 2022
    Inventors: Bin NI, Kirk LIEB, Rick HAWES, Yale SONG, Benoit SCHILLINGS, Vahe OUGHOURLIAN, Jordi VALLMITJANA, Jennelle NYSTROM, Hardik RUPAREL, Michael CHEN, Adam MATHES, Arunkumar BALASUBRAMANIAN, Jian Zhou, Matt Edelman
  • Publication number: 20220391692
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for receiving sensor data generated by one or more sensors that characterizes motion of an object over multiple time steps, providing the sensor data characterizing the motion of the object to a motion prediction neural network having a brain emulation sub-network with an architecture that is specified by synaptic connectivity between neurons in a brain of a biological organism, and processing the sensor data characterizing the motion of the object using the motion prediction neural network having the brain emulation sub-network to generate a network output that defines a prediction characterizing the motion of the object.
    Type: Application
    Filed: June 8, 2021
    Publication date: December 8, 2022
    Inventors: Sarah Ann Laszlo, Bin Ni
  • Patent number: 11481202
    Abstract: Implementations are described herein for building and/or applying a library of transformation templates to automate migration of source code. In various implementations, pre-migration and post-migration versions of source code that exist prior to and after migration of the source code may be analyzed. Based on the analysis, one or more transformations made to the pre-migration version of the source code to yield the post-migration version of the source code may be identified. A library of transformation templates that are applicable subsequently to automate migration of new source code may be built. In some implementations, for one or more of the transformations, a plurality of candidate transformation templates may be generated with different permutations of tokens being replaced with placeholders. One of the plurality of candidate transformation templates may be selected for inclusion in the library based on one or more criteria.
    Type: Grant
    Filed: February 16, 2021
    Date of Patent: October 25, 2022
    Assignee: X DEVELOPMENT LLC
    Inventors: Owen Lewis, Bin Ni
  • Patent number: 11481210
    Abstract: Implementations are described herein for using machine learning to perform various tasks related to migrating source code based on relatively few (“few shots”) demonstrations. In various implementations, an autoregressive language model may be conditioned based on demonstration tuple(s). In some implementations, a demonstration tuple may include a pre-migration version of a first source code snippet and a post-migration version of the first source code snippet. In other implementations, demonstration tuples may include other data, such as intermediate forms (e.g., natural language descriptions or pseudocode), input-output pairs demonstrating intended behavior, etc. The autoregressive language model may be trained on corpora of source code and natural language documentation on the subject of computer programming.
    Type: Grant
    Filed: December 29, 2020
    Date of Patent: October 25, 2022
    Assignee: X DEVELOPMENT LLC
    Inventors: Rishabh Singh, David Andre, Bin Ni, Owen Lewis
  • Patent number: 11461081
    Abstract: Implementations are described herein for adapting existing source code snippets to new contexts. In various implementations, a command may be detected to incorporate an existing source code snippet into destination source code. An embedding may be generated based on the existing source code snippet, e.g., by processing the existing source code snippet using an encoder. The destination source code may be processed to identify one or more decoder constraints. Subject to the one or more decoder constraints, the embedding may be processed using a decoder to generate a new version of the existing source code snippet that is adapted to the destination source code.
    Type: Grant
    Filed: January 27, 2021
    Date of Patent: October 4, 2022
    Assignee: X DEVELOPMENT LLC
    Inventors: Qianyu Zhang, Bin Ni, Rishabh Singh, Olivia Hatalsky
  • Publication number: 20220290989
    Abstract: Implementations are described herein for leveraging teleconnections and location embeddings to predict geospatial measures for a geographic location of interest. In various implementations, a plurality of reference geographic locations may be identified that are disparate from a geographic location of interest and influence a geospatial measure in the geographic location of interest. One or more features may be extracted from each of the plurality of reference geographic locations. The extracted features and a location embedding generated for the geographic location of interest may be encoded into a joint embedding. A sequence encoder may be applied to the joint embedding to generate encoded data indicative of the predicted geospatial measure.
    Type: Application
    Filed: March 12, 2021
    Publication date: September 15, 2022
    Inventors: Grigory Bronevetsky, Charlotte Leroy, Bin Ni, Hongxu Ma, Gengchen Mai
  • Publication number: 20220292330
    Abstract: Implementations are described herein for generating location embeddings that capture spatial dependence and heterogeneity of data, making the embeddings suitable for downstream statistical analysis and/or machine learning processing. In various implementations, a position coordinate for a geographic location of interest may be processed using a spatial dependence encoder to generate a first location embedding that captures spatial dependence of geospatial measure(s) for the geographic location of interest. The position coordinate may also be processed using a spatial heterogeneity encoder to generate a second location embedding that captures spatial heterogeneity of the geospatial measure(s) for the geographic location. A combined embedding corresponding to the geographic location may be generated based on the first and second location embeddings.
    Type: Application
    Filed: March 12, 2021
    Publication date: September 15, 2022
    Inventors: Hongxu Ma, Gengchen Mai, Bin Ni
  • Patent number: 11438637
    Abstract: Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods automatically analyze a live streaming media file, and identify portions of the media that are highlights. The content classified as a highlight can be shared across social media platforms, and indexed for searching respective to attributes of the video content. The streaming and highlight media content is renderable in a novel, modified video player that enables variable playback speeds for how content is classified, and enables on-demand selections of specific content portions and adjustable rendering displays during streaming.
    Type: Grant
    Filed: May 13, 2020
    Date of Patent: September 6, 2022
    Assignee: YAHOO ASSETS LLC
    Inventors: Bin Ni, Kirk Lieb, Rick Hawes, Yale Song, Benoit Schillings, Vahe Oughourlian, Jordi Vallmitjana, Jennelle Nystrom, Hardik Ruparel, Michael Chen, Adam Mathes, Arunkumar Balasubramanian, Jian Zhou, Matt Edelman
  • Publication number: 20220261231
    Abstract: Implementations are described herein for building and/or applying a library of transformation templates to automate migration of source code. In various implementations, pre-migration and post-migration versions of source code that exist prior to and after migration of the source code may be analyzed. Based on the analysis, one or more transformations made to the pre-migration version of the source code to yield the post-migration version of the source code may be identified. A library of transformation templates that are applicable subsequently to automate migration of new source code may be built. In some implementations, for one or more of the transformations, a plurality of candidate transformation templates may be generated with different permutations of tokens being replaced with placeholders. One of the plurality of candidate transformation templates may be selected for inclusion in the library based on one or more criteria.
    Type: Application
    Filed: February 16, 2021
    Publication date: August 18, 2022
    Inventors: Owen Lewis, Bin Ni
  • Publication number: 20220236971
    Abstract: Implementations are described herein for adapting existing source code snippets to new contexts. In various implementations, a command may be detected to incorporate an existing source code snippet into destination source code. An embedding may be generated based on the existing source code snippet, e.g., by processing the existing source code snippet using an encoder. The destination source code may be processed to identify one or more decoder constraints. Subject to the one or more decoder constraints, the embedding may be processed using a decoder to generate a new version of the existing source code snippet that is adapted to the destination source code.
    Type: Application
    Filed: January 27, 2021
    Publication date: July 28, 2022
    Inventors: Qianyu Zhang, Bin Ni, Rishabh Singh, Olivia Hatalsky
  • Publication number: 20220206785
    Abstract: Implementations are described herein for using machine learning to perform various tasks related to migrating source code based on relatively few (“few shots”) demonstrations. In various implementations, an autoregressive language model may be conditioned based on demonstration tuple(s). In some implementations, a demonstration tuple may include a pre-migration version of a first source code snippet and a post-migration version of the first source code snippet. In other implementations, demonstration tuples may include other data, such as intermediate forms (e.g., natural language descriptions or pseudocode), input-output pairs demonstrating intended behavior, etc. The autoregressive language model may be trained on corpora of source code and natural language documentation on the subject of computer programming.
    Type: Application
    Filed: December 29, 2020
    Publication date: June 30, 2022
    Inventors: Rishabh Singh, David Andre, Bin Ni, Owen Lewis
  • Publication number: 20220188081
    Abstract: Implementations are described herein for leveraging prior source code transformations to facilitate automatic creation and/or recommendation of tools for automating aspects of source code transformations captured in real time. In various implementations, a transformation made by a programmer to a source code snipped may be captured in a source code editor application in real time. Based on the transformation and the intent, one or more candidate source code transformations may be identified from one or more repositories of prior source code transformations made by one or more other programmers. The source code editor application may be caused to provide output indicative of a tool that is operable to automate one or more edits associated with both the transformation made by the programmer to the source code snippet and with one or more of the candidate source code transformations.
    Type: Application
    Filed: December 16, 2020
    Publication date: June 16, 2022
    Inventors: Bin Ni, Owen Lewis, Qianyu Zhang
  • Publication number: 20220121427
    Abstract: Techniques are described herein for using artificial intelligence to “learn,” statistically, a target programming style that is imposed in and/or evidenced by a code base. Once the target programming style is learned, it can be used for various purposes. In various implementations, one or more generative adversarial networks (“GANs”), each including a generator machine learning model and a discriminator machine learning model, may be trained to facilitate learning and application of target programming style(s). In some implementations, the discriminator(s) and/or generator(s) may operate on graphical input, and may take the form of graph neural networks (“GNNs”), graph attention neural networks (“GANNs”), graph convolutional networks (“GCNs”), etc., although this is not required.
    Type: Application
    Filed: December 28, 2021
    Publication date: April 21, 2022
    Inventors: Georgios Evangelopoulos, Olivia Hatalsky, Bin Ni, Qianyu Zhang
  • Patent number: 11243746
    Abstract: Techniques are described herein for using artificial intelligence to “learn,” statistically, a target programming style that is imposed in and/or evidenced by a code base. Once the target programming style is learned, it can be used for various purposes. In various implementations, one or more generative adversarial networks (“GANs”), each including a generator machine learning model and a discriminator machine learning model, may be trained to facilitate learning and application of target programming style(s). In some implementations, the discriminator(s) and/or generator(s) may operate on graphical input, and may take the form of graph neural networks (“GNNs”), graph attention neural networks (“GANNs”), graph convolutional networks (“GCNs”), etc., although this is not required.
    Type: Grant
    Filed: July 1, 2019
    Date of Patent: February 8, 2022
    Assignee: X DEVELOPMENT LLC
    Inventors: Georgios Evangelopoulos, Olivia Hatalsky, Bin Ni, Qianyu Zhang
  • Patent number: 11169786
    Abstract: Implementations are described herein for generating embeddings of source code using both the language and graph domains, and leveraging combinations of these semantically-rich and structurally-informative embeddings for various purposes. In various implementations, tokens of a source code snippet may be applied as input across a sequence-processing machine learning model to generate a plurality of token embeddings. A graph may also be generated based on the source code snippet. A joint representation may be generated based on the graph and the incorporated token embeddings. The joint representation generated from the source code snippet may be compared to one or more other joint representations generated from one or more other source code snippets to make a determination about the source code snippet.
    Type: Grant
    Filed: February 4, 2020
    Date of Patent: November 9, 2021
    Assignee: X DEVELOPMENT LLC
    Inventors: Rohan Badlani, Owen Lewis, Georgios Evangelopoulos, Olivia Hatalsky, Bin Ni
  • Patent number: 11152785
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for using a neural network to predict locations of feeders in an electrical power grid. One of the methods includes training a generative adversarial network comprising a generator and a discriminator; and generating, by the generator, from input images, output images with feeder metadata that represents predicted locations of feeder assets, including receiving by the generator a first input image and generating by the generator a corresponding first output image with first feeder data that identifies one or more feeder assets and their respective locations, wherein the one or more feeder assets had not been identified in any input to the generator.
    Type: Grant
    Filed: September 17, 2019
    Date of Patent: October 19, 2021
    Assignee: X Development LLC
    Inventors: Phillip E. Stahlfeld, Bin Ni
  • Publication number: 20210304011
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for identifying one or more regions of a brain of a biological organism that are predicted to be functionally-specialized for performing a task. In one aspect, a method comprises: obtaining data defining a synaptic connectivity graph representing synaptic connectivity between neurons in the brain of the biological organism; identifying a plurality of sub-graphs of the synaptic connectivity graph; determining, for each sub-graph of the plurality of sub-graphs, a performance measure characterizing a performance of a neural network having a neural network architecture that is specified by the sub-graph in accomplishing the task; and determining, based on the performance measures, that one or more sub-graphs of the plurality of sub-graphs correspond to regions of the brain of the biological organism that are predicted to be functionally-specialized for performing the task.
    Type: Application
    Filed: March 25, 2020
    Publication date: September 30, 2021
    Inventors: Sarah Ann Laszlo, Matthew Sibigtroth, Bin Ni
  • Publication number: 20210298624
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for neuroanatomical tract visualization using synaptic connectivity graphs. In one aspect, a method comprises: presenting, to a user and through a display, a representation of a synaptic connectivity graph representing synaptic connectivity between neurons in a brain of a biological organism; receiving, from the user, data specifying a seed neuron in the brain; identifying a neuroanatomical tract corresponding to the seed neuron in the brain; and presenting, to the user and through the display, a geometric representation of at least a portion of the brain of the biological organism that visually distinguishes the neuroanatomical tract corresponding to the seed neuron at neuronal resolution.
    Type: Application
    Filed: March 25, 2020
    Publication date: September 30, 2021
    Inventors: Sarah Ann Laszlo, Jeffrey Bush, Bin Ni, Matthew Sibigtroth
  • Publication number: 20210240453
    Abstract: Implementations are described herein for generating embeddings of source code using both the language and graph domains, and leveraging combinations of these semantically-rich and structurally-informative embeddings for various purposes. In various implementations, tokens of a source code snippet may be applied as input across a sequence-processing machine learning model to generate a plurality of token embeddings. A graph may also be generated based on the source code snippet. A joint representation may be generated based on the graph and the incorporated token embeddings. The joint representation generated from the source code snippet may be compared to one or more other joint representations generated from one or more other source code snippets to make a determination about the source code snippet.
    Type: Application
    Filed: February 4, 2020
    Publication date: August 5, 2021
    Inventors: Rohan Badlani, Owen Lewis, Georgios Evangelopoulos, Olivia Hatalsky, Bin Ni
  • Patent number: 11064284
    Abstract: An in-ear device includes a housing shaped to hold the in-ear device in an ear of a user, and an audio package, disposed in the housing, to emit augmented sound. A first set of one or more microphones is positioned to receive external sound, and a controller is coupled to the audio package and the first set of one or more microphones. The controller includes a low-latency audio processing path, digital control parameters, and logic that when executed by the controller causes the in-ear device to perform operations. The operations may include receiving the external sound with the first set of one or more microphones to generate a low-latency sound signal; augmenting the low-latency sound signal by passing the low-latency sound signal through the low-latency audio processing path to produce an augmented sound signal; and outputting, with the audio package, the augmented sound based on the augmented sound signal.
    Type: Grant
    Filed: December 28, 2018
    Date of Patent: July 13, 2021
    Assignee: X Development LLC
    Inventors: Jason Rugolo, Bin Ni, Cyrus Behroozi