Patents by Inventor JinJun Xiong

JinJun Xiong has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240144425
    Abstract: Techniques for using machine learning (ML) for image processing are disclosed. First encoded image data, generated by encoding a first one or more digital images using an encoder, is received. A first reconstructed one or more digital images are generated by decoding the encoded image data using a decoder corresponding to the encoder. A second reconstructed one or more digital images are generated by transforming the first reconstructed one or more digital images using a super-resolution ML model. The second reconstructed one or more digital images has a higher image resolution compared with the first reconstructed one or more digital images, and the super-resolution ML model is trained based on an image resolution corresponding to at least one of the second reconstructed one or more digital images.
    Type: Application
    Filed: November 1, 2022
    Publication date: May 2, 2024
    Inventors: Jinjun XIONG, Nicholas CHEN, James WEI, Vikram Sharma MAILTHODY
  • Patent number: 11880765
    Abstract: A processor training a reinforcement learning model can include receiving a first dataset representing an observable state in reinforcement learning to train a machine to perform an action. The processor receives a second dataset. Using the second dataset, the processor trains a machine learning classifier to make a prediction about an entity related to the action. The processor extracts an embedding from the trained machine learning classifier, and augments the observable state with the embedding to create an augmented state. Based on the augmented state, the processor trains a reinforcement learning model to learn a policy for performing the action, the policy including a mapping from state space to action space.
    Type: Grant
    Filed: October 19, 2020
    Date of Patent: January 23, 2024
    Assignees: International Business Machines Corporation, University of Illinois at Urbana-Champaign
    Inventors: Pin-Yu Chen, Yada Zhu, Jinjun Xiong, Kumar Bhaskaran, Yunan Ye, Bo Li
  • Patent number: 11768511
    Abstract: An exemplary method includes solving on a computing system an optimal power flow formulation for a plurality of generators in a power system. The solving includes computing using multi-threaded parallelism a plurality of constraints for the formulation, computing using multi-threaded parallelism a plurality of Jacobian functions of the constraints, and computing using multi-threaded parallelism a Hessian of Lagrangian functions. The method further includes outputting results of the solving, wherein the results comprise values of generation levels for the plurality of generators. Apparatus and program products are also disclosed.
    Type: Grant
    Filed: January 21, 2022
    Date of Patent: September 26, 2023
    Assignee: Utopus Insights, Inc.
    Inventors: Gary Ditlow, Dung Phan, Jinjun Xiong
  • Patent number: 11704486
    Abstract: A computer-implemented method for generating an abstract meaning representation (“AMR”) of a sentence, comprising receiving, by a computing device, an input sentence and parsing the input sentence into one or more syntactic and/or semantic graphs. An input graph including a node set and an edge set is formed from the one or more syntactic and/or semantic graphs. Node representations are generated by natural language processing. The input graph is provided to a first neural network to provide an output graph having learned node representations aligned with the node representations in the input graph. The method further includes predicting via a second neural network, node label and predicting, via a third neural network, edge labels in the output graph. The AMR is generated based on the predicted node labels and predicted edge labels. A system and a non-transitory computer readable storage medium are also disclosed.
    Type: Grant
    Filed: December 1, 2020
    Date of Patent: July 18, 2023
    Assignees: INTERNATIONAL BUSINESS MACHINES CORPORATION, THE BOARD OF TRUSTEES OF THE UNIVERSITY OF ILLINOIS
    Inventors: Lingfei Wu, Jinjun Xiong, Hongyu Gong, Suma Bhat, Wen-Mei Hwu
  • Publication number: 20230214705
    Abstract: An input transformation function that transforms input data for a second machine learning system is learned using a first machine learning system, the learning being based on minimizing a summation of a task loss and a post-activation density loss. The input data is transformed using the learned input transformation function to alter the post-activation density to reduce an amount of energy consumed for an inferencing task and the inferencing task is carried out on the transformed input data using the second machine learning system.
    Type: Application
    Filed: December 30, 2021
    Publication date: July 6, 2023
    Inventors: Pin-Yu Chen, Nandhini Chandramoorthy, Karthik V Swaminathan, Jinjun Xiong, Devansh Paresh Shah, Bo Li
  • Publication number: 20220392429
    Abstract: A computer-implemented method is provided of using a machine learning model for disentanglement of prosody in spoken natural language. The method includes encoding, by a computing device, the spoken natural language to produce content code. The method further includes resampling, by the computing device without text transcriptions, the content code to obscure the prosody by applying an unsupervised technique to the machine learning model to generate prosody-obscured content code. The method additionally includes decoding, by the computing device, the prosody-obscured content code to synthesize speech indirectly based upon the content code.
    Type: Application
    Filed: June 3, 2021
    Publication date: December 8, 2022
    Inventors: Kaizhi Qian, Yang Zhang, Shiyu Chang, Jinjun Xiong, Chuang Gan, David Cox
  • Patent number: 11521044
    Abstract: Techniques regarding action detection based on motion in receptive fields of a neural network model are provided. For example, one or more embodiments described herein can comprise a system, which can comprise a memory that can store computer executable components. The system can also comprise a processor, operably coupled to the memory, and that can execute the computer executable components stored in the memory. The computer executable components can comprise a motion component that can extract a motion vector from a plurality of adaptive receptive fields in a deformable convolution layer of a neural network model. The computer executable components can also comprise an action detection component that can generate a spatio-temporal feature by concatenating the motion vector with a spatial feature extracted from the deformable convolution layer.
    Type: Grant
    Filed: May 17, 2018
    Date of Patent: December 6, 2022
    Assignees: INTERNATIONAL BUSINESS MACHINES CORPORATION, THE BOARD OF TRUSTEES OF THE UNIVERSITY OF ILLINOIS
    Inventors: Khoi-Nguyen C. Mac, Raymond Alexander Yeh, Dhiraj Joshi, Minh N. Do, Rogerio Feris, Jinjun Xiong
  • Publication number: 20220303333
    Abstract: One or more metrics associated with performance of a serverless function chain are received. The one or more metrics are used by a reinforcement learning (RL) model to tune the serverless function chain.
    Type: Application
    Filed: June 1, 2022
    Publication date: September 22, 2022
    Inventors: Jinjun Xiong, Roland Ludwig Huss, Huamin Chen
  • Publication number: 20220284277
    Abstract: One or more machine learning models for a network of tensor time series can be provided. Co-evolving time series having multiple modes can be received. A tensor graph convolutional network can be trained, using the co-evolving time series and adjacency matrices associated with the multiple modes in the co-evolving time series, to generate node embeddings associated with a snapshot of the co-evolving time series at time t. A tensor recurrent neural network can be trained to generate temporal dynamics associated with the co-evolving time series based on the generated node embeddings. A neural network model can be trained to forecast a prediction for the co-evolving time series based on the generated node embeddings and the generated temporal dynamics. The tensor graph convolutional network, the tensor recurrent neural network and the neural network model can be trained jointly.
    Type: Application
    Filed: February 25, 2021
    Publication date: September 8, 2022
    Inventors: Yada Zhu, Hanghang Tong, Baoyu Jing, Jinjun Xiong, Nitin Gaur, Anna Wanda Topol
  • Publication number: 20220253426
    Abstract: Time series data can be received. A machine learning model can be trained using the time series data. A contaminating process can be estimated based on the time series data, the contaminating process including outliers associated with the time series data. A parameter associated with the contaminating process can be determined. Based on the trained machine learning model and the parameter associated with the contaminating process, a single-valued metric can be determined, which represents an impact of the contaminating process on the machine learning model's future prediction. A plurality of different outlier detecting machine learning models can be used to estimate the contaminating process and the single-valued metric can be determined for each of the plurality of different outlier detecting machine learning models. The plurality of different outlier detecting machine learning models can be ranked according to the associated single-valued metric.
    Type: Application
    Filed: February 8, 2021
    Publication date: August 11, 2022
    Inventors: Yada Zhu, Jinjun Xiong, Jingrui He, Lecheng Zheng, Xiaodong Cui
  • Publication number: 20220237448
    Abstract: A method includes detecting, by a webhook controller, an inference serverless function invocation. The method further includes determining that the inference serverless function can be optimized. The method further includes generating an optimized version of the inference serverless function using a graph compiler, in response to the determining. The method further includes replacing, by a processing device of the webhook controller, a storage volume in an init container of the inference serverless function with a new storage volume comprising the optimized version of the inference serverless function.
    Type: Application
    Filed: January 28, 2021
    Publication date: July 28, 2022
    Inventors: Huamin Chen, Jinjun Xiong, Roland Ludwig Huss
  • Patent number: 11394742
    Abstract: One or more computer processors generate a plurality of adversarial perturbations associated with a model, wherein the plurality of adversarial perturbations comprises a universal perturbation and one or more per-sample perturbations. The one or more computer processors identify a plurality of neuron activations associated with the model and the plurality of generated adversarial perturbations. The one or more computer processors maximize the identified plurality of neuron activations. The one or more computer processors determine the model is a Trojan model by leveraging one or more similarities associated with the maximized neuron activations and the generated adversarial perturbations.
    Type: Grant
    Filed: August 17, 2020
    Date of Patent: July 19, 2022
    Assignee: International Business Machines Corporation
    Inventors: Sijia Liu, Pin-Yu Chen, Jinjun Xiong, Gaoyuan Zhang, Meng Wang, Ren Wang
  • Patent number: 11368521
    Abstract: One or more metrics associated with performance of a serverless function chain are received. The one or more metrics are analyzed by a reinforcement learning (RL) model to determine a tuning factor in view of a goal provided to the RL model. The tuning factor is transmitted to a serverless function controller, wherein the serverless function controller is to utilize the tuning factor to tune the serverless function chain.
    Type: Grant
    Filed: March 12, 2021
    Date of Patent: June 21, 2022
    Assignee: Red Hat, Inc.
    Inventors: Jinjun Xiong, Roland Ludwig Huss, Huamin Chen
  • Publication number: 20220171923
    Abstract: A computer-implemented method for generating an abstract meaning representation (“AMR”) of a sentence, comprising receiving, by a computing device, an input sentence and parsing the input sentence into one or more syntactic and/or semantic graphs. An input graph including a node set and an edge set is formed from the one or more syntactic and/or semantic graphs. Node representations are generated by natural language processing. The input graph is provided to a first neural network to provide an output graph having learned node representations aligned with the node representations in the input graph. The method further includes predicting via a second neural network, node label and predicting, via a third neural network, edge labels in the output graph. The AMR is generated based on the predicted node labels and predicted edge labels. A system and a non-transitory computer readable storage medium are also disclosed.
    Type: Application
    Filed: December 1, 2020
    Publication date: June 2, 2022
    Inventors: Lingfei Wu, Jinjun Xiong, Hongyu Gong, Suma Bhat, Wen-Mei Hwu
  • Publication number: 20220147089
    Abstract: An exemplary method includes solving on a computing system an optimal power flow formulation for a plurality of generators in a power system. The solving includes computing using multi-threaded parallelism a plurality of constraints for the formulation, computing using multi-threaded parallelism a plurality of Jacobian functions of the constraints, and computing using multi-threaded parallelism a Hessian of Lagrangian functions. The method further includes outputting results of the solving, wherein the results comprise values of generation levels for the plurality of generators. Apparatus and program products are also disclosed.
    Type: Application
    Filed: January 21, 2022
    Publication date: May 12, 2022
    Applicant: Utopus Insights, Inc.
    Inventors: Gary Ditlow, Dung Phan, Jinjun Xiong
  • Patent number: 11327973
    Abstract: Embodiments for providing critical path analysis of active trace files in a cloud computing environment. A critical path may be identified using a trace of time spans and activities of a plurality of applications, wherein the critical path is a set of activities having time spans free of overlap with other activities.
    Type: Grant
    Filed: January 24, 2020
    Date of Patent: May 10, 2022
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: I-Hsin Chung, Jinjun Xiong, Carl Pearson
  • Patent number: 11314950
    Abstract: A computer-implemented method is provided for transferring a target text style using Reinforcement Learning (RL). The method includes pre-determining, by a Long Short-Term Memory (LSTM) Neural Network (NN), the target text style of a target-style natural language sentence. The method further includes transforming, by a hardware processor using the LSTM NN, a source-style natural language sentence into the target-style natural language sentence that maintains the target text style of the target-style natural language sentence. The method also includes calculating an accuracy rating of a transformation of the source-style natural language sentence into the target-style natural language sentence based upon rewards relating to at least the target text style of the source-style natural language sentence.
    Type: Grant
    Filed: March 25, 2020
    Date of Patent: April 26, 2022
    Assignees: INTERNATIONAL BUSINESS MACHINES CORPORATION, THE BOARD OF TRUSTEES OF THE UNIVERSITY OF ILLINOIS
    Inventors: Lingfei Wu, Jinjun Xiong, Hongyu Gong, Suma Bhat, Wen-Mei Hwu
  • Publication number: 20220121921
    Abstract: A processor training a reinforcement learning model can include receiving a first dataset representing an observable state in reinforcement learning to train a machine to perform an action. The processor receives a second dataset. Using the second dataset, the processor trains a machine learning classifier to make a prediction about an entity related to the action. The processor extracts an embedding from the trained machine learning classifier, and augments the observable state with the embedding to create an augmented state. Based on the augmented state, the processor trains a reinforcement learning model to learn a policy for performing the action, the policy including a mapping from state space to action space.
    Type: Application
    Filed: October 19, 2020
    Publication date: April 21, 2022
    Inventors: Pin-Yu Chen, Yada Zhu, Jinjun Xiong, Kumar Bhaskaran, Yunan Ye, Bo Li
  • Patent number: 11283855
    Abstract: A method includes determining a first upload start timestamp and a first upload end timestamp of a video file from a client device to an object storage device. The method further includes monitoring an upload of the video file from the object storage device to a server-less framework to determine a second upload start timestamp and a second upload end timestamp of the video file. The method further includes determining, by a processing device, a latency of the upload in view of the first upload timestamp, the second upload timestamp, the first upload end timestamp, and the second upload end timestamp. The method further includes providing a latency adjustment instruction to the client device in view of the latency.
    Type: Grant
    Filed: January 7, 2021
    Date of Patent: March 22, 2022
    Assignee: Red Hat, Inc.
    Inventors: Huamin Chen, Jinjun Xiong
  • Publication number: 20220053005
    Abstract: One or more computer processors generate a plurality of adversarial perturbations associated with a model, wherein the plurality of adversarial perturbations comprises a universal perturbation and one or more per-sample perturbations. The one or more computer processors identify a plurality of neuron activations associated with the model and the plurality of generated adversarial perturbations. The one or more computer processors maximize the identified plurality of neuron activations. The one or more computer processors determine the model is a Trojan model by leveraging one or more similarities associated with the maximized neuron activations and the generated adversarial perturbations.
    Type: Application
    Filed: August 17, 2020
    Publication date: February 17, 2022
    Inventors: Sijia Liu, Pin-Yu Chen, Jinjun Xiong, GAOYUAN ZHANG, Meng Wang, Ren Wang