Patents Assigned to PETUUM, INC.
-
Patent number: 11543830Abstract: An unsupervised real to virtual domain unification model for highway driving, or DU-drive, employs a conditional generative adversarial network to transform driving images in a real domain to their canonical representations in the virtual domain, from which vehicle control commands are predicted. In the case where there are multiple real datasets, a real-to-virtual generator may be independently trained for each real domain and a global predictor could be trained with data from multiple real domains. Qualitative experiment results show this model can effectively transform real images to the virtual domain while only keeping the minimal sufficient information, and quantitative results verify that such canonical representation can eliminate domain shift and boost the performance of control command prediction task.Type: GrantFiled: September 24, 2018Date of Patent: January 3, 2023Assignee: PETUUM, INC.Inventors: Xiaodan Liang, Eric P Xing
-
Publication number: 20220261694Abstract: Methods and systems are presented for consuming different data sources, and deploying artificial intelligence and machine learning programs on different target devices or infrastructures. Many data types can be transformed into machine learning data shards (MLDS) while many machine learning programs written in various programming languages or frameworks are transformed to common operator representations. Operator representations are transformed into execution graphs (EG) for a chosen target device or infrastructure. The MLDS and EG are input to the targeted devices and infrastructures, which then execute the machine learning programs (now transformed to EGs) on the MLDS to produce trained models or predictions with trained models.Type: ApplicationFiled: May 2, 2022Publication date: August 18, 2022Applicant: Petuum Inc.Inventors: Qirong Ho, Eric Xing
-
Patent number: 11348030Abstract: Methods and systems are presented for consuming different data sources, and deploying artificial intelligence and machine learning programs on different target devices or infrastructures. Many data types can be transformed into machine learning data shards (MLDS) while many machine learning programs written in various programming languages or frameworks are transformed to common operator representations. Operator representations are transformed into execution graphs (EG) for a chosen target device or infrastructure. The MLDS and EG are input to the targeted devices and infrastructures, which then execute the machine learning programs (now transformed to EGs) on the MLDS to produce trained models or predictions with trained models.Type: GrantFiled: December 20, 2017Date of Patent: May 31, 2022Assignee: Petuum Inc.Inventors: Qirong Ho, Eric Xing
-
Patent number: 11301438Abstract: Accordingly, a data engineering system for machine learning at scale is disclosed. In one embodiment, the data engineering system includes an ingest processing module having a schema update submodule and a feature statistics update submodule, wherein the schema update submodule is configured to discover new features and add them to a schema, and wherein the feature statistics update submodule collects statistics for each feature to be used in an online transformation, a record store to store data from a data source, and a transformation module, to receive a low dimensional data instance from the record store and to receive the schema and feature statistics from the ingest processing module, and to transform the low dimensional data instance into a high dimensional representation.Type: GrantFiled: September 2, 2020Date of Patent: April 12, 2022Assignee: Petuum Inc.Inventors: Wei Dai, Weiren Yu, Eric Xing
-
Patent number: 11282205Abstract: Organ segmentation in chest X-rays using convolutional neural networks is disclosed. One embodiment provides a method to train a convolutional segmentation network with chest X-ray images to generate pixel-level predictions of target classes. Another embodiment will also train a critic network with an input mask, wherein the input mask is one of a segmentation network mask and a ground truth annotation, and outputting a probability that the input mask is the ground truth annotation instead of the prediction by the segmentation network, and to provide the probability output by the critic network to the segmentation network to guide the segmentation network to generate masks more consistent with learned higher-order structures.Type: GrantFiled: April 1, 2020Date of Patent: March 22, 2022Assignee: PETUUM, INC.Inventors: Wei Dai, Xiaodan Liang, Hao Zhang, Eric Xing, Joseph Doyle
-
Patent number: 11252260Abstract: A computer in a distributed peer-to-peer system is disclosed. The distributed system includes a plurality of computers configured to run a distributed machine learning (ML) program represented as an expression of a target loss function with a model parameter matrix. The computer includes: a parser module configured to convert a loss function in the distributed program into an expression graph and then one or more multiplication trees; a parameter replica module in communication with the parser module, the parameter replica module configured to maintain the model parameter matrix of the ML program; a compressor module in communication with the parameter replica module, the compressor module configured to extract sufficient factors from the expression graph for updating the model matrix; and a communication module in communication with the compressor module, the communication module configured to send the sufficient factors for updating model matrix to other machines in the distributed system.Type: GrantFiled: December 20, 2017Date of Patent: February 15, 2022Assignee: PETUUM INCInventors: Pengtao Xie, Qirong Ho, Eric Xing
-
Publication number: 20210343410Abstract: The present invention is a system and a method to classify clinical records into International Classification of Diseases (ICD) codes. The system includes a processor, and a memory communicatively coupled to the processor. The memory includes a generator (G), a feature extractor, a discriminator (D), a label encoder, and a keywords reconstructor. The generator (G) generates synthesized features corresponding to ICD code descriptions. The feature extractor extracts real latent features from clinical documents and generates real features by training a GANs. The generator (G) generates synthesized features after the GANs are trained and calibrate a binary code classifier with the real latent features generated by the feature extractor for a low-shot ICD code l. The feature extractor generates code-specific latent features conditioned on a textual description of each ICD code description by using a WGAN-GP.Type: ApplicationFiled: May 2, 2020Publication date: November 4, 2021Applicant: Petuum Inc.Inventors: Shanghang Zhang, Najmeh Sadoughi, Pengtao Xie, Eric Xing
-
Publication number: 20210335469Abstract: A system for assigning concepts to a medical image includes a visual feature module and a tagging module. The visual feature module is configured to obtain an image feature vector from the medical image. The tagging module is configured to apply a machine-learned algorithm to the image feature vector to assign a set of concepts to the image. The system may also include a text report generator that is configured to generate a written report describing the medical image based on the set of concepts assigned to the medical image.Type: ApplicationFiled: July 2, 2021Publication date: October 28, 2021Applicant: Petuum, Inc.Inventors: Pengtao Xie, Eric P. Xing
-
Patent number: 11119992Abstract: Accordingly, a data engineering system for machine learning at scale is disclosed. In one embodiment, the data engineering system includes an ingest processing module having a schema update submodule and a feature statistics update submodule, wherein the schema update submodule is configured to discover new features and add them to a schema, and wherein the feature statistics update submodule collects statistics for each feature to be used in an online transformation, a record store to store data from a data source, and a transformation module, to receive a low dimensional data instance from the record store and to receive the schema and feature statistics from the ingest processing module, and to transform the low dimensional data instance into a high dimensional representation.Type: GrantFiled: April 23, 2018Date of Patent: September 14, 2021Assignee: PETUUM, INC.Inventors: Wei Dai, Weiren Yu, Eric Xing
-
Patent number: 11106998Abstract: A computer in a distributed computing system is disclosed. The computer includes: a graphics processing unit (GPU) memory; a central processing unit (CPU) memory comprising a Key-Value Store (KVS) module; an execution engine module configured to run a deep learning (DL) program to create a plurality of operator graph layers in the graphics processing unit memory; a client library module configured to create a GPU-CPU synchronization (GCS) module for each of the plurality of operator graph layers; a coordination service module configured to compute network cost of a first and a second communication scheme and select, based on the network cost, one of the first and second communication scheme for transmitting data associated with one of the plurality of operator graph layers from a corresponding GCS module.Type: GrantFiled: November 16, 2017Date of Patent: August 31, 2021Assignee: PETUUM INCInventors: Wei Dai, Hao Zhang, Eric Xing, Qirong Ho
-
Patent number: 11101029Abstract: A system for predicting medications to prescribe to a patient includes a text encoding module and a medication prediction module. The text encoding module is configured to obtain a clinical-information vector from clinical information of the patient. The medication prediction module configured to apply a machine-learned medication-prediction algorithm to the clinical-information vector to select a subset of medications to prescribe to the patient. The machine-learned medication-prediction algorithm is designed with a diversity-promoting regularization model, and is configured to simultaneously consider correlations among different medications and dependencies between patient information and medications when selecting a subset of medications to prescribe to the patient.Type: GrantFiled: December 1, 2018Date of Patent: August 24, 2021Assignee: PETUUM INC.Inventors: Pengtao Xie, Eric Xing
-
Patent number: 11087864Abstract: A system for assigning concepts to a medical image includes a visual feature module and a tagging module. The visual feature module is configured to obtain an image feature vector from the medical image. The tagging module is configured to apply a machine-learned algorithm to the image feature vector to assign a set of concepts to the image. The system may also include a text report generator that is configured to generate a written report describing the medical image based on the set of concepts assigned to the medical image.Type: GrantFiled: December 1, 2018Date of Patent: August 10, 2021Assignee: PETUUM INC.Inventors: Pengtao Xie, Eric Xing
-
Patent number: 10832387Abstract: A system for manipulating images according to styles chosen by a user includes a feed-forward image manipulation model for everyday use and an optimization image manipulation model for more professional use. The optimization image manipulation model optimizes directly over output image pixels to minimize both the content loss and style loss. Users can select their own content and style images, and can choose between using the feed-forward image manipulation model and optimization image manipulation model.Type: GrantFiled: April 5, 2018Date of Patent: November 10, 2020Assignee: PETUUM INC.Inventors: Zhiting Hu, Eric Xing, Chenyu Wang
-
Patent number: 10782988Abstract: A system including a master machine and a plurality of worker machines is disclosed. The master machine includes, for example, an API server configured to receive a job description; a resource allocation module configured to determine a number of virtual machines required to perform a job based on the job description; a container scheduling module configured to create a container containing the number of virtual machines required to perform the job, wherein at least two of the virtual machines in the container resides on different worker machines, and wherein each of the virtual machines is configured to run a same application to perform the job.Type: GrantFiled: October 27, 2017Date of Patent: September 22, 2020Assignee: Petuum Inc.Inventors: Wei Dai, Weiren Yu, Eric P Xing, Aurick Qiao, Qirong Ho
-
Patent number: 10706234Abstract: A constituent-centric neural architecture for reading comprehension is disclosed. One embodiment provides a method that performs reading comprehension comprising encoding individual constituents from a text passage using a chain of trees long short-term encoding, encodes question related to the text passage using a tree long short-term memory encoding, generates a question-aware representation for each constituent in the passage using a tree-guided attention mechanism, generates a plurality of candidate answers from the question-aware representation using hierarchical relations among constituents, and predicts an answer to the question in relation to the text passage using a feed-forward network. Other embodiments are disclosed herein.Type: GrantFiled: April 9, 2018Date of Patent: July 7, 2020Assignee: Petuum Inc.Inventors: Pengtao Xie, Eric Xing
-
Patent number: 10699412Abstract: Organ segmentation in chest X-rays using convolutional neural networks is disclosed. One embodiment provides a method to train a convolutional segmentation network with chest X-ray images to generate pixel-level predictions of target classes. Another embodiment will also train a critic network with an input mask, wherein the input mask is one of a segmentation network mask and a ground truth annotation, and outputting a probability that the input mask is the ground truth annotation instead of the prediction by the segmentation network, and to provide the probability output by the critic network to the segmentation network to guide the segmentation network to generate masks more consistent with learned higher-order structures.Type: GrantFiled: March 20, 2018Date of Patent: June 30, 2020Assignee: PETUUM INC.Inventors: Wei Dai, Xiaodan Liang, Hao Zhang, Eric Xing, Joseph Doyle
-
Patent number: 10649806Abstract: A computer system implemented a method for elastic resource management for executing a machine learning (ML) program.Type: GrantFiled: April 11, 2018Date of Patent: May 12, 2020Assignee: PETUUM, INC.Inventors: Aurick Qiao, Qirong Ho, Eric Xing