Patents by Inventor Bin Ni
Bin Ni has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20250085942Abstract: Implementations are described herein for adapting existing source code snippets to new contexts. In various implementations, a command may be detected to incorporate an existing source code snippet into destination source code. An embedding may be generated based on the existing source code snippet, e.g., by processing the existing source code snippet using an encoder. The destination source code may be processed to identify one or more decoder constraints. Subject to the one or more decoder constraints, the embedding may be processed using a decoder to generate a new version of the existing source code snippet that is adapted to the destination source code.Type: ApplicationFiled: November 26, 2024Publication date: March 13, 2025Inventors: Qianyu Zhang, Bin Ni, Rishabh Singh, Olivia Hatalsky
-
Patent number: 12250415Abstract: Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods automatically analyze a live streaming media file, and identify portions of the media that are highlights. The content classified as a highlight can be shared across social media platforms, and indexed for searching respective to attributes of the video content. The streaming and highlight media content is renderable in a novel, modified video player that enables variable playback speeds for how content is classified, and enables on-demand selections of specific content portions and adjustable rendering displays during streaming.Type: GrantFiled: August 30, 2022Date of Patent: March 11, 2025Assignee: YAHOO ASSETS LLCInventors: Bin Ni, Kirk Lieb, Rick Hawes, Yale Song, Benoit Schillings, Vahe Oughourlian, Jordi Vallmitjana, Jennelle Nystrom, Hardik Ruparel, Michael Chen, Adam Mathes, Arunkumar Balasubramanian, Jian Zhou, Matt Edelman
-
Patent number: 12182555Abstract: Implementations are described herein for adapting existing source code snippets to new contexts. In various implementations, a command may be detected to incorporate an existing source code snippet into destination source code. An embedding may be generated based on the existing source code snippet, e.g., by processing the existing source code snippet using an encoder. The destination source code may be processed to identify one or more decoder constraints. Subject to the one or more decoder constraints, the embedding may be processed using a decoder to generate a new version of the existing source code snippet that is adapted to the destination source code.Type: GrantFiled: October 12, 2023Date of Patent: December 31, 2024Assignee: GOOGLE LLCInventors: Qianyu Zhang, Bin Ni, Rishabh Singh, Olivia Hatalsky
-
Patent number: 12093671Abstract: Techniques are described herein for translating source code using sparse-self attention. In various implementations, a source code snippet in a first programming language may be processed to obtain graph(s) representing snippet tokens, and relationships therebetween. Based on the graph(s), a subset of snippet token pairs may be identified from a superset of all possible token pairs in the source code snippet. Each token pair of the subset may include snippet tokens that are represented by nodes connected by one or more edges of the one or more graphs. A self-attention network of a translation machine learning model may be adapted to sparsely attend across the identified subset of token pairs. The source code snippet may then be processed based on the adapted translation machine learning model to generate a translation of the source code snippet in the second programming language.Type: GrantFiled: April 28, 2022Date of Patent: September 17, 2024Assignee: GOOGLE LLCInventors: Rishabh Singh, Bin Ni, Manzil Zaheer
-
Patent number: 12046901Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for using a neural network to predict locations of feeders in an electrical power grid. One of the methods includes training a generative adversarial network comprising a generator and a discriminator; and generating, by the generator, from input images, output images with feeder metadata that represents predicted locations of feeder assets, including receiving by the generator a first input image and generating by the generator a corresponding first output image with first feeder data that identifies one or more feeder assets and their respective locations, wherein the one or more feeder assets had not been identified in any input to the generator.Type: GrantFiled: February 8, 2023Date of Patent: July 23, 2024Assignee: X Development LLCInventors: Phillip Ellsworth Stahlfeld, Bin Ni
-
Patent number: 12001821Abstract: Implementations are described herein for leveraging prior source code transformations to facilitate automatic creation and/or recommendation of tools for automating aspects of source code transformations captured in real time. In various implementations, a transformation made by a programmer to a source code snipped may be captured in a source code editor application in real time. Based on the transformation and the intent, one or more candidate source code transformations may be identified from one or more repositories of prior source code transformations made by one or more other programmers. The source code editor application may be caused to provide output indicative of a tool that is operable to automate one or more edits associated with both the transformation made by the programmer to the source code snippet and with one or more of the candidate source code transformations.Type: GrantFiled: March 9, 2023Date of Patent: June 4, 2024Inventors: Bin Ni, Owen Lewis, Qianyu Zhang
-
Publication number: 20240086164Abstract: Techniques are described herein for generating synthetic paired source code snippets that are semantically equivalent but syntactically distinct. In various implementations, few shot learning may be performed to prompt a large language model, based on demonstration source code snippet(s) in syntactically constrained pseudocode, to generate additional source code snippets in the syntactically constrained pseudocode. Based on additional source code snippets in additional programming language(s), the large language model may be used to generate more training source code snippets in the syntactically constrained pseudocode. The training source code snippets in the syntactically constrained pseudocode may be programmatically translated to generate synthetic training pairs of semantically equivalent source code snippets.Type: ApplicationFiled: September 8, 2022Publication date: March 14, 2024Inventors: Lucas Kramer, Bin Ni
-
Patent number: 11893384Abstract: Implementations are described herein for leveraging machine learning to automate source code refactoring and/or rearchitecting. In various implementations, one or more ground truth boundaries may be removed from one or more boundaried source code files to produce one or more boundary-less source code files. One or more of the boundary-less source code files may be processed using a machine learning model to predict one or more candidate boundaries for reintroduction into the one or more boundary-less source code files. The one or more ground truth boundaries may be compared with the one or more predicted candidate boundaries. The machine learning model may be trained based on the comparing.Type: GrantFiled: February 10, 2022Date of Patent: February 6, 2024Assignee: GOOGLE LLCInventors: Bin Ni, Joshua Howland
-
Publication number: 20240036843Abstract: Implementations are described herein for adapting existing source code snippets to new contexts. In various implementations, a command may be detected to incorporate an existing source code snippet into destination source code. An embedding may be generated based on the existing source code snippet, e.g., by processing the existing source code snippet using an encoder. The destination source code may be processed to identify one or more decoder constraints. Subject to the one or more decoder constraints, the embedding may be processed using a decoder to generate a new version of the existing source code snippet that is adapted to the destination source code.Type: ApplicationFiled: October 12, 2023Publication date: February 1, 2024Inventors: Qianyu Zhang, Bin Ni, Rishabh Singh, Olivia Hatalsky
-
Patent number: 11886850Abstract: Implementations are described herein for building and/or applying a library of transformation templates to automate migration of source code. In various implementations, pre-migration and post-migration versions of source code that exist prior to and after migration of the source code may be analyzed. Based on the analysis, one or more transformations made to the pre-migration version of the source code to yield the post-migration version of the source code may be identified. A library of transformation templates that are applicable subsequently to automate migration of new source code may be built. In some implementations, for one or more of the transformations, a plurality of candidate transformation templates may be generated with different permutations of tokens being replaced with placeholders. One of the plurality of candidate transformation templates may be selected for inclusion in the library based on one or more criteria.Type: GrantFiled: September 6, 2022Date of Patent: January 30, 2024Assignee: GOOGLE LLCInventors: Owen Lewis, Bin Ni
-
Patent number: 11842174Abstract: Techniques are described herein for translating source code in one programming language to source code in another programming language using machine learning. In various implementations, one or more components of one or more generative adversarial networks, such as a generator machine learning model, may be trained to generate “synthetically-naturalistic” source code that can be used as a translation of source code in an unfamiliar language. In some implementations, a discriminator machine learning model may be employed to aid in training the generator machine learning model, e.g., by being trained to discriminate between human-generated (“genuine”) and machine-generated (“synthetic”) source code.Type: GrantFiled: July 9, 2019Date of Patent: December 12, 2023Assignee: GOOGLE LLCInventors: Bin Ni, Zhiqiang Yuan, Qianyu Zhang
-
Patent number: 11822909Abstract: Implementations are described herein for adapting existing source code snippets to new contexts. In various implementations, a command may be detected to incorporate an existing source code snippet into destination source code. An embedding may be generated based on the existing source code snippet, e.g., by processing the existing source code snippet using an encoder. The destination source code may be processed to identify one or more decoder constraints. Subject to the one or more decoder constraints, the embedding may be processed using a decoder to generate a new version of the existing source code snippet that is adapted to the destination source code.Type: GrantFiled: September 1, 2022Date of Patent: November 21, 2023Assignee: GOOGLE LLCInventors: Qianyu Zhang, Bin Ni, Rishabh Singh, Olivia Hatalsky
-
Publication number: 20230350657Abstract: Techniques are described herein for translating source code using sparse-self attention. In various implementations, a source code snippet in a first programming language may be processed to obtain graph(s) representing snippet tokens, and relationships therebetween. Based on the graph(s), a subset of snippet token pairs may be identified from a superset of all possible token pairs in the source code snippet. Each token pair of the subset may include snippet tokens that are represented by nodes connected by one or more edges of the one or more graphs. A self-attention network of a translation machine learning model may be adapted to sparsely attend across the identified subset of token pairs. The source code snippet may then be processed based on the adapted translation machine learning model to generate a translation of the source code snippet in the second programming language.Type: ApplicationFiled: April 28, 2022Publication date: November 2, 2023Inventors: Rishabh Singh, Bin Ni, Manzil Zaheer
-
Patent number: 11748065Abstract: Techniques are described herein for using artificial intelligence to “learn,” statistically, a target programming style that is imposed in and/or evidenced by a code base. Once the target programming style is learned, it can be used for various purposes. In various implementations, one or more generative adversarial networks (“GANs”), each including a generator machine learning model and a discriminator machine learning model, may be trained to facilitate learning and application of target programming style(s). In some implementations, the discriminator(s) and/or generator(s) may operate on graphical input, and may take the form of graph neural networks (“GNNs”), graph attention neural networks (“GANNs”), graph convolutional networks (“GCNs”), etc., although this is not required.Type: GrantFiled: December 28, 2021Date of Patent: September 5, 2023Assignee: GOOGLE LLCInventors: Georgios Evangelopoulos, Olivia Hatalsky, Bin Ni, Qianyu Zhang
-
Publication number: 20230251856Abstract: Implementations are described herein for leveraging machine learning to automate source code refactoring and/or rearchitecting. In various implementations, one or more ground truth boundaries may be removed from one or more boundaried source code files to produce one or more boundary-less source code files. One or more of the boundary-less source code files may be processed using a machine learning model to predict one or more candidate boundaries for reintroduction into the one or more boundary-less source code files. The one or more ground truth boundaries may be compared with the one or more predicted candidate boundaries. The machine learning model may be trained based on the comparing.Type: ApplicationFiled: February 10, 2022Publication date: August 10, 2023Inventors: Bin Ni, Joshua Howland
-
Publication number: 20230214195Abstract: Implementations are described herein for leveraging prior source code transformations to facilitate automatic creation and/or recommendation of tools for automating aspects of source code transformations captured in real time. In various implementations, a transformation made by a programmer to a source code snipped may be captured in a source code editor application in real time. Based on the transformation and the intent, one or more candidate source code transformations may be identified from one or more repositories of prior source code transformations made by one or more other programmers. The source code editor application may be caused to provide output indicative of a tool that is operable to automate one or more edits associated with both the transformation made by the programmer to the source code snippet and with one or more of the candidate source code transformations.Type: ApplicationFiled: March 9, 2023Publication date: July 6, 2023Inventors: Bin Ni, Owen Lewis, Qianyu Zhang
-
Patent number: 11656867Abstract: Implementations are described herein for using machine learning to perform various tasks related to migrating source code based on relatively few (“few shots”) demonstrations. In various implementations, an autoregressive language model may be conditioned based on demonstration tuple(s). In some implementations, a demonstration tuple may include a pre-migration version of a first source code snippet and a post-migration version of the first source code snippet. In other implementations, demonstration tuples may include other data, such as intermediate forms (e.g., natural language descriptions or pseudocode), input-output pairs demonstrating intended behavior, etc. The autoregressive language model may be trained on corpora of source code and natural language documentation on the subject of computer programming.Type: GrantFiled: September 15, 2022Date of Patent: May 23, 2023Assignee: GOOGLE LLCInventors: Rishabh Singh, David Andre, Bin Ni, Owen Lewis
-
Patent number: 11636349Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for identifying one or more regions of a brain of a biological organism that are predicted to be functionally-specialized for performing a task. In one aspect, a method comprises: obtaining data defining a synaptic connectivity graph representing synaptic connectivity between neurons in the brain of the biological organism; identifying a plurality of sub-graphs of the synaptic connectivity graph; determining, for each sub-graph of the plurality of sub-graphs, a performance measure characterizing a performance of a neural network having a neural network architecture that is specified by the sub-graph in accomplishing the task; and determining, based on the performance measures, that one or more sub-graphs of the plurality of sub-graphs correspond to regions of the brain of the biological organism that are predicted to be functionally-specialized for performing the task.Type: GrantFiled: March 25, 2020Date of Patent: April 25, 2023Assignee: X Development LLCInventors: Sarah Ann Laszlo, Matthew Sibigtroth, Bin Ni
-
Patent number: 11611213Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for using a neural network to predict locations of feeders in an electrical power grid. One of the methods includes training a generative adversarial network comprising a generator and a discriminator; and generating, by the generator, from input images, output images with feeder metadata that represents predicted locations of feeder assets, including receiving by the generator a first input image and generating by the generator a corresponding first output image with first feeder data that identifies one or more feeder assets and their respective locations, wherein the one or more feeder assets had not been identified in any input to the generator.Type: GrantFiled: October 11, 2021Date of Patent: March 21, 2023Assignee: X Development LLCInventors: Phillip E. Stahlfeld, Bin Ni
-
Patent number: 11604628Abstract: Implementations are described herein for leveraging prior source code transformations to facilitate automatic creation and/or recommendation of tools for automating aspects of source code transformations captured in real time. In various implementations, a transformation made by a programmer to a source code snipped may be captured in a source code editor application in real time. Based on the transformation and the intent, one or more candidate source code transformations may be identified from one or more repositories of prior source code transformations made by one or more other programmers. The source code editor application may be caused to provide output indicative of a tool that is operable to automate one or more edits associated with both the transformation made by the programmer to the source code snippet and with one or more of the candidate source code transformations.Type: GrantFiled: December 16, 2020Date of Patent: March 14, 2023Assignee: GOOGLE LLCInventors: Bin Ni, Owen Lewis, Qianyu Zhang