Patents Issued in May 30, 2023
  • Patent number: 11663445
    Abstract: A server communicating with a dishwasher is disclosed. The server communicating with a dishwasher, according to an embodiment of the present invention, comprises: a communication unit for communicating with one or more dishwashers; a memory for storing learning results obtained using a plurality of failure causes and operation information corresponding to each of the plurality of failure causes; and a processor for receiving operation information of a particular dishwasher among the one or more dishwashers from the particular dishwasher, and acquiring the cause of a failure occurring in the particular dishwasher by using the operation information of the particular dishwasher and the learning results, wherein the learning results include relational parameters corresponding to the relationships between the plurality of failure causes and the operation information.
    Type: Grant
    Filed: February 1, 2019
    Date of Patent: May 30, 2023
    Assignee: LG ELECTRONICS INC.
    Inventors: Seongju Lim, Changseok Ock
  • Patent number: 11663446
    Abstract: The present disclosure relates to a device for executing a convolutional neural network operation. The device comprises a first memory, a processing array comprising a plurality of processing strings, and a controller. The controller can be configured to fetch one or more batches of data into the first memory, regroup the one or more batches of data into multiple work items, wherein a first work item partially overlaps one or more work items among the multiple work items, and broadcast the multiple work items to the processing array, wherein the first work item is transferred to two or more processing strings of the processing array.
    Type: Grant
    Filed: January 6, 2020
    Date of Patent: May 30, 2023
    Assignee: Alibaba Group Holding Limited
    Inventors: Yang Jiao, Long Chen, Yi Jung Su
  • Patent number: 11663447
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for receiving graph data representing an input graph comprising a plurality of vertices connected by edges; generating, from the graph data, vertex input data representing characteristics of each vertex in the input graph and pair input data representing characteristics of pairs of vertices in the input graph; and generating order-invariant features of the input graph using a neural network, wherein the neural network comprises: a first subnetwork configured to generate a first alternative representation of the vertex input data and a first alternative representation of the pair input data from the vertex input data and the pair input data; and a combining layer configured to receive an input alternative representation and to process the input alternative representation to generate the order-invariant features.
    Type: Grant
    Filed: August 24, 2021
    Date of Patent: May 30, 2023
    Assignee: Google LLC
    Inventors: Patrick F. Riley, Marc Berndl
  • Patent number: 11663448
    Abstract: Systems, methods, and computer program products are provided for determining an event parameter are provided. Event data can be matched to a grid comprising gridlines and cells defined by the gridlines. The grid can be mapped to a predetermined area. Each cell can comprise a number of events per predetermined time interval. The cells can be sorted into classes based on the number of events occurring during the predetermined time interval to produce a classified data set. Features can be extracted from the classified data set. The extracted features can be processed using a classifier to determine the event parameter for a future time interval in at least one cell of the cells, for example, crime events. The classifier can comprise a neural network. Systems can comprise one or more of a processor, a neural network, and a user interface.
    Type: Grant
    Filed: June 28, 2019
    Date of Patent: May 30, 2023
    Assignee: Conduent Business Services, LLC
    Inventor: Niraj Kumar
  • Patent number: 11663449
    Abstract: Techniques and mechanisms for providing a logical state machine with a spiking neural network which includes multiple sets of nodes. Each of the multiple sets of nodes is to implement a different respective state, and each of the multiple spike trains is provided to respective nodes of each of the multiple sets of nodes. A given state of the logical state machine is implemented by configuring respective activation modes of each node of the corresponding set of nodes. The activation mode of a given node enables that node to signal, responsive to its corresponding spike train, that a respective state transition of the logical state machine is to be performed. In another embodiment, the multiple spike trains each represent a different respective character in a system used by data evaluated with the spiking neural network.
    Type: Grant
    Filed: December 15, 2017
    Date of Patent: May 30, 2023
    Assignee: Intel Corporation
    Inventors: Arnab Paul, Narayan Srinivasa
  • Patent number: 11663450
    Abstract: Hardware and methods for neural network processing are provided. A method in a hardware node including a pipeline having a matrix vector unit (MVU), a first multifunction unit connected to receive an input from the matrix vector unit, a second multifunction unit connected to receive an output from the first multifunction unit, and a third multifunction unit connected to receive an output from the second multifunction unit is provided. The method includes performing using the MVU a first type of instruction that can only be performed by the MVU to generate a first result. The method further includes performing a second type of instruction that can only be performed by one of the multifunction units and generating a second result and without storing the any of the two results in a global register, passing the second result to the second multifunction and the third multifunction unit.
    Type: Grant
    Filed: June 29, 2017
    Date of Patent: May 30, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Jeremy Fowers, Eric S. Chung, Douglas C. Burger
  • Patent number: 11663451
    Abstract: A 2D array-based neuromorphic processor includes: axon circuits each being configured to receive a first input corresponding to one bit from among bits indicating n-bit activation; first direction lines extending in a first direction from the axon circuits; second direction lines intersecting the first direction lines; synapse circuits disposed at intersections of the first direction lines and the second direction lines, and each being configured to store a second input corresponding to one bit from among bits indicating an m-bit weight and to output operation values of the first input and the second input; and neuron circuits connected to the second direction lines, each of the neuron circuits being configured to receive an operation value output from at least one of the synapse circuits, based on time information assigned individually to the synapse circuits, and to perform a multi-bit operation by using the operation values and the time information.
    Type: Grant
    Filed: February 13, 2019
    Date of Patent: May 30, 2023
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Sungho Kim, Cheheung Kim, Jaeho Lee
  • Patent number: 11663452
    Abstract: An apparatus is described. The apparatus includes a circuit to process a binary neural network. The circuit includes an array of processing cores, wherein, processing cores of the array of processing cores are to process different respective areas of a weight matrix of the binary neural network. The processing cores each include add circuitry to add only those weights of an i layer of the binary neural network that are to be effectively multiplied by a non zero nodal output of an i?1 layer of the binary neural network.
    Type: Grant
    Filed: September 25, 2019
    Date of Patent: May 30, 2023
    Assignee: Intel Corporation
    Inventors: Ram Krishnamurthy, Gregory K. Chen, Raghavan Kumar, Phil Knag, Huseyin Ekin Sumbul, Deepak Vinayak Kadetotad
  • Patent number: 11663453
    Abstract: There is provided with an information processing apparatus. A control unit controls writing of weight data to a first memory and a second memory, and controls readout of the weight data from the first memory and the second memory. The control unit further switches an operation between a first operation in which a processing unit reads out first weight data from the first memory and performs the convolution operation processing using the first weight data while the processing unit writes second weight data to the second memory in parallel, and a second operation in which the processing unit reads out the first weight data from both the first memory and the second memory and performs the convolution operation processing using the first weight data.
    Type: Grant
    Filed: January 3, 2020
    Date of Patent: May 30, 2023
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Daisuke Nakashima, Tse-Wei Chen
  • Patent number: 11663454
    Abstract: A digital integrated circuit with embedded memory for neural network inferring may include a controller and a matrix of processing blocks and cyclic bidirectional interconnections, where each processing block is coupled to 4 neighboring processing blocks regardless of its position in the matrix. A cyclic bidirectional interconnection may transmit every processing block's output to its upper, lower, left, right neighboring blocks or to its cyclic neighbors of the same row or column in replacement of any missing upper, lower, left or right neighbors. Each processing block may include invariant word buffers, variant word buffers, a multiplexer, and a processing unit. The multiplexer may select one of the 4 neighbor processing blocks' outputs. The processing unit may accept as inputs the multiplexer's selected value, a selected value from the variant word buffers and a selected value from the invariant word buffer and produce output which acts as the processing block's output.
    Type: Grant
    Filed: March 27, 2020
    Date of Patent: May 30, 2023
    Assignee: Aspiring Sky Co. Limited
    Inventors: Yujie Wen, Zhijiong Luo
  • Patent number: 11663455
    Abstract: A resistive random-access memory cell includes a well region, a first doped region, a second doped region, a third doped region, a first gate structure, a second gate structure and a third gate structure. The first gate structure is formed over the surface of the well region between the first doped region and the second doped region. The second gate structure is formed over the second doped region. The third gate structure is formed over the surface of the well region between the second doped region and the third doped region. A first metal layer is connected with the first doped region and the third doped region. A second metal layer is connected with the conductive layer of the first gate structure and the conductive layer of the third gate structure.
    Type: Grant
    Filed: November 24, 2020
    Date of Patent: May 30, 2023
    Assignee: EMEMORY TECHNOLOGY INC.
    Inventors: Tsung-Mu Lai, Wei-Chen Chang, Hsueh-Wei Chen
  • Patent number: 11663456
    Abstract: A mechanism is described for facilitating the transfer of features learned by a context independent pre-trained deep neural network to a context dependent neural network. The mechanism includes extracting a feature learned by a first deep neural network (DNN) model via the framework, wherein the first DNN model is a pre-trained DNN model for computer vision to enable context-independent classification of an object within an input video frame and training, via the deep learning framework, a second DNN model for computer vision based on the extracted feature, the second DNN model an update of the first DNN model, wherein training the second DNN model includes training the second DNN model based on a dataset including context-dependent data.
    Type: Grant
    Filed: August 12, 2021
    Date of Patent: May 30, 2023
    Assignee: Intel Corporation
    Inventor: Raanan Yonatan Yehezkel Rohekar
  • Patent number: 11663457
    Abstract: A non-volatile synapse circuit of a non-volatile neural network. The synapse includes: a first input signal line for providing a first input signal; a reference signal line for providing a reference signal; first and second output lines for carrying first and second output signals therethrough, and first and second cells for generating the first and second output signals, respectively. Each of the first and second cells includes: a first upper select transistor having a gate that is electrically coupled to the first input signal line; and a first resistive changing element having one end connected to the first select transistor in series and another end electrically coupled to the reference signal line. The value of the first resistive changing element may be programmable to change the magnitude of an output signal.
    Type: Grant
    Filed: May 5, 2022
    Date of Patent: May 30, 2023
    Assignee: Anaflash Inc.
    Inventor: Seung-Hwan Song
  • Patent number: 11663458
    Abstract: A method of operating a neuromorphic system is provided. The method includes applying voltage signals across input lines of a crossbar array structure, the crossbar array structure including rows and columns interconnected at junctions via programmable electronic devices, the rows including the input lines for applying voltage signals across the electronic devices and the columns including output lines for outputting currents. The method also includes correcting, via a correction unit connected to the output lines, each of the output currents obtained at the output lines according to an affine transformation to compensate for temporal conductance variations in the electronic devices.
    Type: Grant
    Filed: April 8, 2020
    Date of Patent: May 30, 2023
    Assignee: International Business Machines Corporation
    Inventors: Vinay Manikrao Joshi, Simon Haefeli, Manuel Le Gallo-Bourdeau, Irem Boybat Kara, Abu Sebastian
  • Patent number: 11663459
    Abstract: A hybrid neuromorphic computing device is provided, in which artificial neurons include light-emitting devices that provide weighted sums of inputs as light output. The output is detected by a photodetector and converted to an electrical output. Each neuron may receive output from one or more other neurons as initial input, allowing for high degrees of fan-out and fan-in, including true broadcast-to-all functionality.
    Type: Grant
    Filed: June 8, 2021
    Date of Patent: May 30, 2023
    Assignee: Universal Display Corporation
    Inventor: Michael Hack
  • Patent number: 11663460
    Abstract: A data exchange method, a data exchange device, and a computing device for data exchange between a provider and a recipient for machine learning, the method including: (a) receiving a machine learning model from the provider (S1100); (b) respectively transforming output data samples into corresponding output eigenvectors by utilizing the machine learning model from the provider (S1200); (c) after transformation, combining the output eigenvectors with corresponding identifiers to form exchange samples (S1300). According to the data exchange method, original data is transformed into vector information which cannot be restored but can be applied to machine learning, for use in exchange, so as to, on one hand, enable efficient use of data for machine learning and, on the other hand, prevent unauthorized use, sale or disclosure of the original data.
    Type: Grant
    Filed: February 16, 2017
    Date of Patent: May 30, 2023
    Assignee: THE FOURTH PARADIGM (BEIJING) TECH CO LTD
    Inventors: Yuqiang Chen, Wenyuan Dai
  • Patent number: 11663461
    Abstract: Instruction distribution in an array of neural network cores is provided. In various embodiments, a neural inference chip is initialized with core microcode. The chip comprises a plurality of neural cores. The core microcode is executable by the neural cores to execute a tensor operation of a neural network. The core microcode is distributed to the plurality of neural cores via an on-chip network. The core microcode is executed synchronously by the plurality of neural cores to compute a neural network layer.
    Type: Grant
    Filed: July 5, 2018
    Date of Patent: May 30, 2023
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Hartmut Penner, Dharmendra S. Modha, John V. Arthur, Andrew S. Cassidy, Rathinakumar Appuswamy, Pallab Datta, Steven K. Esser, Myron D. Flickner, Jennifer Klamo, Jun Sawada, Brian Taba
  • Patent number: 11663462
    Abstract: A machine learning method and a machine learning device are provided. The machine learning method includes: receiving an input signal and performing normalization on the input signal; transmitting the normalized input signal to a convolutional layer; and adding a sparse coding layer after the convolutional layer, wherein the sparse coding layer uses dictionary atoms to reconstruct signals on a projection of the normalized input signal passing through the convolutional layer, and the sparse coding layer receives a mini-batch input to refresh the dictionary atoms.
    Type: Grant
    Filed: July 10, 2018
    Date of Patent: May 30, 2023
    Assignee: National Central University
    Inventors: Jia-Ching Wang, Chien-Yao Wang, Chih-Hsuan Yang
  • Patent number: 11663463
    Abstract: A location-sensitive saliency prediction neural network generates location-sensitive saliency data for an image. The location-sensitive saliency prediction neural network includes, at least, a filter module, an inception module, and a location-bias module. The filter module extracts visual features at multiple contextual levels, and generates a feature map of the image. The inception module generates a multi-scale semantic structure, based on multiple scales of semantic content depicted in the image. In some cases, the inception block performs parallel analysis of the feature map, such as by parallel multiple layers, to determine the multiple scales of semantic content. The location-bias module generates a location-sensitive saliency map of location-dependent context of the image based on the multi-scale semantic structure and on a bias map. In some cases, the bias map indicates location-specific weights for one or more regions of the image.
    Type: Grant
    Filed: July 10, 2019
    Date of Patent: May 30, 2023
    Assignee: Adobe Inc.
    Inventors: Kumar Ayush, Atishay Jain
  • Patent number: 11663464
    Abstract: A system for operating a floating-to-fixed arithmetic framework includes a floating-to-fix arithmetic framework on an arithmetic operating hardware such as a central processing unit (CPU) for computing a floating pre-trained convolution neural network (CNN) model to a dynamic fixed-point CNN model. The dynamic fixed-point CNN model is capable of implementing a high performance convolution neural network (CNN) on a resource limited embedded system such as mobile phone or video cameras.
    Type: Grant
    Filed: August 27, 2019
    Date of Patent: May 30, 2023
    Assignee: Kneron (Taiwan) Co., Ltd.
    Inventors: Jie Wu, Bike Xie, Hsiang-Tsun Li, Junjie Su, Chun-Chen Liu
  • Patent number: 11663465
    Abstract: An artificial neural network system for managing a task to be performed by heterogeneous resources executing an artificial neural network, the artificial neural network system including a model analyzer that receives an artificial neural network model and outputs sub-graph information generated based on the artificial neural network model including at least one of sub-graph, a detector that outputs awareness information about the heterogeneous resources, and a task manager that outputs a first request signal for performing a task with respect to each layer of first resource of the heterogeneous resources based on the sub-graph information and the awareness information, and a second request signal for performing an task with respect to each depth of a second resource of the heterogeneous resources.
    Type: Grant
    Filed: November 1, 2019
    Date of Patent: May 30, 2023
    Assignee: Samsung Electronics Co., Ltd.
    Inventor: Seung-soo Yang
  • Patent number: 11663466
    Abstract: A method for generating a dual-class dataset is disclosed. A single-class dataset and a context dataset are obtained. The context dataset can be labeled. A model can be trained using the combination of the single-class dataset and the labeled context dataset. The model can be run on the context dataset. The data points that are classified the same as the data points included in the single-class dataset, can be removed from the labeled context dataset and added to the single-class dataset. These steps can be repeated until no data points are classified by the model.
    Type: Grant
    Filed: November 18, 2019
    Date of Patent: May 30, 2023
    Assignee: CAPITAL ONE SERVICES, LLC
    Inventors: Fardin Abdi Taghi Abad, Reza Farivar, Vincent Pham, Kenneth Taylor, Mark Watson, Jeremy Goodsitt, Austin Walters, Anh Truong
  • Patent number: 11663467
    Abstract: Embodiments of the present invention provide systems, methods, and non-transitory computer storage media for generating an ambient occlusion (AO) map for a 2D image that can be combined with the 2D image to adjust the contrast of the 2D image based on the geometric information in the 2D image. In embodiments, using a trained neural network, an AO map for a 2D image is automatically generated without any predefined 3D scene information. Optimizing the neural network to generate an estimated AO map for a 2D image requires training, testing, and validating the neural network using a synthetic dataset comprised of pairs of images and ground truth AO maps rendered from 3D scenes. By using an estimated AO map to adjust the contrast of a 2D image, the contrast of the image can be adjusted to make the image appear lifelike by modifying the shadows and shading in the image based on the ambient lighting present in the image.
    Type: Grant
    Filed: November 21, 2019
    Date of Patent: May 30, 2023
    Assignee: ADOBE INC.
    Inventors: Long Mai, Yannick Hold-Geoffroy, Naoto Inoue, Daichi Ito, Brian Lynn Price
  • Patent number: 11663468
    Abstract: A method for training a neural network, includes: training a super network to obtain a network parameter of the super network, wherein each network layer of the super network includes multiple candidate network sub-structures in parallel; for each network layer of the super network, selecting, from the multiple candidate network sub-structures, a candidate network sub-structure to be a target network sub-structure; constructing a sub-network based on target network sub-structures each selected in a respective network layer of the super network; and training the sub-network, by taking the network parameter inherited from the super network as an initial parameter of the sub-network, to obtain a network parameter of the sub-network.
    Type: Grant
    Filed: January 16, 2020
    Date of Patent: May 30, 2023
    Assignee: Beijing Xiaomi Intelligent Technology Co., Ltd.
    Inventors: Xiangxiang Chu, Ruijun Xu, Bo Zhang, Jixiang Li, Qingyuan Li, Bin Wang
  • Patent number: 11663469
    Abstract: A method for controlling an artificial intelligent (AI) device providing a travel service, and which includes learning, via a processer of the AI device, a plurality of daily patterns related with a user's wake-up time, a commuting time, and a travel route using a deep neural networks (DNN) model; determining, via the processor, whether the daily patterns satisfy predetermined conditions each time a corresponding daily pattern among the plurality of daily patterns is generated; determining, via the processor, that the user is currently traveling when at least one daily pattern among the plurality of daily patterns that does not satisfy the predetermined conditions is detected; setting, via the processor, a time when the at least one daily pattern that does not satisfy the predetermined conditions is detected for a first time as a starting point of travel; setting, via the processor, a time from the starting point of the travel to an end point of the travel as a travel period of the user when an end of the use
    Type: Grant
    Filed: February 20, 2020
    Date of Patent: May 30, 2023
    Assignee: LG ELECTRONICS INC.
    Inventors: Jinhwa Hong, Soojin Lee, Ilhwan Choi, Munho Yun, Sunghyun Park
  • Patent number: 11663470
    Abstract: An accelerating boot time system includes a memory and a processor. The memory is configured to pre-store a boot process to be performed on the first boot. The processor is configured to directly read the boot process from the memory and execute the boot process when the first boot is performed. Also, the processor executes a monitoring process to monitor a plurality of hardware usage rates of the plurality of devices each time the device is powered up, and inserts the hardware usage rates into a machine learning algorithm to determine whether a particular process supported by the devices is abnormal.
    Type: Grant
    Filed: March 27, 2020
    Date of Patent: May 30, 2023
    Assignee: ACER INCORPORATED
    Inventors: Mei-Chun Wu, Ling-Fan Tsao, Shu-Chun Liao
  • Patent number: 11663471
    Abstract: Non-volatile memory structures for performing compute in memory inferencing for neural networks are presented. To improve performance, both in terms of speed and energy consumption, weight matrices are replaced with their singular value decomposition (SVD) and use of a low rank approximations (LRAs). The decomposition matrices can be stored in a single array, with the resultant LRA matrices requiring fewer weight values to be stored. The reduced sizes of the LRA matrices allow for inferencing to be performed more quickly and with less power. In a high performance and energy efficiency mode, a reduced rank for the SVD matrices stored on a memory die is determined and used to increase performance and reduce power needed for an inferencing operation.
    Type: Grant
    Filed: June 26, 2020
    Date of Patent: May 30, 2023
    Assignee: SanDisk Technologies LLC
    Inventors: Tung Thanh Hoang, Won Ho Choi, Martin Lueker-Boden
  • Patent number: 11663472
    Abstract: Techniques and apparatuses are described for deep neural network (DNN) processing for a user equipment-coordination set (UECS). A network entity selects (910) an end-to-end (E2E) machine-learning (ML) configuration that forms an E2E DNN for processing UECS communications. The network entity directs (915) each device of multiple devices participating in an UECS to form, using at least a portion of the E2E ML configuration, a respective sub-DNN of the E2E DNN that transfers the UECS communications through the E2E communication, where the multiple devices include at least one base station, a coordinating user equipment (UE), and at least one additional UE. The network entity receives (940) feedback associated with the UECS communications and identifies (945) an adjustment to the E2E ML configuration. The network entity then directs at least some of the multiple devices participating in an UECS to update the respective sub-DNN of the E2E DNN based on the adjustment.
    Type: Grant
    Filed: June 29, 2020
    Date of Patent: May 30, 2023
    Assignee: Google LLC
    Inventors: Jibing Wang, Erik Richard Stauffer
  • Patent number: 11663473
    Abstract: A neural network apparatus configured to perform a deconvolution operation includes a memory configured to store a first kernel; and a processor configured to: obtain, from the memory, the first kernel; calculate a second kernel by adjusting an arrangement of matrix elements comprised in the first kernel; generate sub-kernels by dividing the second kernel; perform a convolution operation between an input feature map and the sub-kernels using a convolution operator; and generate an output feature map, as a deconvolution of the input feature map, by merging results of the convolution operation.
    Type: Grant
    Filed: December 4, 2020
    Date of Patent: May 30, 2023
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Joonho Song, Sehwan Lee, Junwoo Jang
  • Patent number: 11663474
    Abstract: Aspects of the disclosure generally relate to computing enabled devices and/or systems, and may be generally directed to devices, systems, methods, and/or applications for learning a device's operation in various circumstances, storing this knowledge in a knowledgebase (i.e. neural network, graph, sequences, etc.), and enabling autonomous operation of the device.
    Type: Grant
    Filed: December 26, 2021
    Date of Patent: May 30, 2023
    Inventor: Jasmin Cosic
  • Patent number: 11663475
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training an action selection neural network that is used to select actions to be performed by a reinforcement learning agent interacting with an environment. In particular, the actions are selected from a continuous action space and the system trains the action selection neural network jointly with a distribution Q network that is used to update the parameters of the action selection neural network.
    Type: Grant
    Filed: September 15, 2022
    Date of Patent: May 30, 2023
    Assignee: DeepMind Technologies Limited
    Inventors: David Budden, Matthew William Hoffman, Gabriel Barth-Maron
  • Patent number: 11663476
    Abstract: Disclosed herein are a method and apparatus for compressing learning parameters for training of a deep-learning model and transmitting the compressed parameters in a distributed processing environment. Multiple electronic devices in the distributed processing system perform training of a neural network. By performing training, parameters are updated. The electronic device may share the updated parameter thereof with additional electronic devices. In order to efficiently share the parameter, the residual of the parameter is provided to the additional electronic devices. When the residual of the parameter is provided, the additional electronic devices update the parameter using the residual of the parameter.
    Type: Grant
    Filed: December 13, 2018
    Date of Patent: May 30, 2023
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Seung-Hyun Cho, Youn-Hee Kim, Jin-Wuk Seok, Joo-Young Lee, Woong Lim, Jong-Ho Kim, Dae-Yeol Lee, Se-Yoon Jeong, Hui-Yong Kim, Jin-Soo Choi, Je-Won Kang
  • Patent number: 11663477
    Abstract: Systems, methods, and non-transitory computer-readable media can be configured to determine a video embedding for a video content item based at least in part on a first machine learning model. A set of music embeddings can be determined for a set of music content items based at least in part on a second machine learning model. The set of music content items can be ranked based at least in part on the video embedding and the set of music embeddings.
    Type: Grant
    Filed: November 19, 2021
    Date of Patent: May 30, 2023
    Assignee: Meta Platforms, Inc.
    Inventors: Parth Popatlal Detroja, Bokai Cao, Amit Kumar Singh
  • Patent number: 11663478
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for characterizing activity in a recurrent artificial neural network. In one aspect, a method for identifying decision moments in a recurrent artificial neural network includes determining a complexity of patterns of activity in the recurrent artificial neural network, wherein the activity is responsive to input into the recurrent artificial neural network, determining a timing of activity having a complexity that is distinguishable from other activity that is responsive to the input, and identifying the decision moment based on the timing of the activity that has the distinguishable complexity.
    Type: Grant
    Filed: June 11, 2018
    Date of Patent: May 30, 2023
    Assignee: INAIT SA
    Inventors: Henry Markram, Ran Levi, Kathryn Pamela Hess Bellwald
  • Patent number: 11663479
    Abstract: Provided is a method of constructing a neural network translation model. The method includes generating a first neural network translation model learning a feature of source domain data used in an unspecific field, generating a second neural network translation model learning a feature of target domain data used in a specific field, generating a third neural network translation model learning a common feature of the source domain data and the target domain data; and generating a combiner combining translation results of the first to third neural network translation models.
    Type: Grant
    Filed: February 14, 2018
    Date of Patent: May 30, 2023
    Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
    Inventors: Yo Han Lee, Young Kil Kim
  • Patent number: 11663480
    Abstract: An autonomic function executing in an artificial intelligence environment determines that a fused model responsive to a new problem space has below a threshold level of accuracy in the new problem space. A spliced layer in the fused model is autonomically cloned, the spliced layer having been extracted from a second model and inserted at a location in the fused model. The cloned layer is autonomically inserted at a second location in the fused model. An automatically constructed vector transformation transforms an output vector of a previous layer in an immediately previous location in the model relative to the second location. The cloned layer is automatically fused in the fused model using the transformed output vector as input to the cloned layer, forming a deep fused model that has a revised accuracy that is higher than the accuracy relative to an ontology of the new problem space.
    Type: Grant
    Filed: November 15, 2019
    Date of Patent: May 30, 2023
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Aaron K. Baughman, Michael Behrendt, Shikhar Kwatra, Craig M. Trim
  • Patent number: 11663481
    Abstract: The disclosure describes one or more implementations of a neural network architecture pruning system that automatically and progressively prunes neural networks. For instance, the neural network architecture pruning system can automatically reduce the size of an untrained or previously-trained neural network without reducing the accuracy of the neural network. For example, the neural network architecture pruning system jointly trains portions of a neural network while progressively pruning redundant subsets of the neural network at each training iteration. In many instances, the neural network architecture pruning system increases the accuracy of the neural network by progressively removing excess or redundant portions (e.g., channels or layers) of the neural network. Further, by removing portions of a neural network, the neural network architecture pruning system can increase the efficiency of the neural network.
    Type: Grant
    Filed: February 24, 2020
    Date of Patent: May 30, 2023
    Assignee: Adobe Inc.
    Inventors: Shikun Liu, Zhe Lin, Yilin Wang, Jianming Zhang, Federico Perazzi
  • Patent number: 11663482
    Abstract: A method identifies a text region in an electronic document. The method determines that the text region includes a candidate text portion that is a candidate for applying a formatting suggestion based on a comparison of the text region with predetermined patterns. The method identifies a stored text record that corresponds to the candidate text portion. The method confirms whether the formatting type is appropriate for the candidate text portion based on individual word matches between the candidate text portion and the stored text record. The method notifies a user of the electronic document of the formatting suggestion according to the formatting type.
    Type: Grant
    Filed: July 6, 2018
    Date of Patent: May 30, 2023
    Assignee: Google LLC
    Inventors: Abraham Ittycheriah, Adam Tishok, Max Kessler, Peter Likarish
  • Patent number: 11663483
    Abstract: According to embodiments, an encoder neural network receives a one-hot representation of a real text. The encoder neural network outputs a latent representation of the real text. A decoder neural network receives random noise data or artificial code generated by a generator neural network from random noise data. The decoder neural network outputs softmax representation of artificial text. The decoder neural network receives the latent representation of the real text. The decoder neural network outputs a reconstructed softmax representation of the real text. A hybrid discriminator neural network receives a first combination of the soft-text and the latent representation of the real text and a second combination of the softmax representation of artificial text and the artificial code. The hybrid discriminator neural network outputs a probability indicating whether the second combination is similar to the first combination. Additional embodiments for utilizing latent representation are also disclosed.
    Type: Grant
    Filed: October 30, 2018
    Date of Patent: May 30, 2023
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Md Akmal Haidar, Mehdi Rezagholizadeh
  • Patent number: 11663484
    Abstract: Embodiments of the present application disclose a content generation method and apparatus. The method includes: acquiring product description information; selecting, by using a deep neural network model component, a content phrase matched with the product description information, wherein the deep neural network model component is obtained by training according to a plurality of pieces of historical product description information and historical content of the historical product description information; and generating content corresponding to the product description information based on the selected content phrase.
    Type: Grant
    Filed: December 21, 2018
    Date of Patent: May 30, 2023
    Assignee: Alibaba Group Holding Limited
    Inventors: Qunmeng Zheng, Jianxing Xiao, Zhiqiang Zhang, Yongliang Wang, Mu Li, Yangjian Chen, Yuqi Chen
  • Patent number: 11663485
    Abstract: A system performs distributed or parallel pattern extraction and clustering for pattern classification of large layouts of electronic circuits. The system identifies circuit patterns with a layout representation. The system encodes the circuit patterns using a neural network based autoencoder to generate encoded circuit patterns that can be stored efficiently. The system clusters the encoded circuit patterns into an arbitrary number of clusters based upon a high degree of similarity. The clusters of circuit patterns may be used for training and evaluation of machine learning based models.
    Type: Grant
    Filed: May 18, 2020
    Date of Patent: May 30, 2023
    Assignee: Synopsys, Inc.
    Inventor: Thomas Christopher Cecil
  • Patent number: 11663486
    Abstract: Various embodiments are provided for providing machine learning with noisy label data in a computing environment using one or more processors in a computing system. A label corruption probability of noisy labels may be estimated for selected data from a dataset using temporal inconsistency in a machine model prediction during a training operation in a neural network.
    Type: Grant
    Filed: June 23, 2020
    Date of Patent: May 30, 2023
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Yang Sun, Abhishek Kolagunda, Xiaolong Wang, Steven Nicholas Eliuk
  • Patent number: 11663487
    Abstract: A method includes: generating a refine image having a maximized correct label score of inference from an incorrect image from which an incorrect label is inferred by a neural network; generating a third map by superimposing a first map and a second map, the first map indicating pixels to each of which a change is made in generating the refine image, of a plurality of pixels of the incorrect image, the second map indicating a degree of attention for each local region in the refine image, the each local region being a region that has drawn attention by the neural network; and specifying a set of pixels that cause incorrect inference in the incorrect image by calculating a pixel value of the third map for each set of pixels, wherein the map generating processing adjusts the second map based on appearance frequency of each degree of attention.
    Type: Grant
    Filed: September 25, 2020
    Date of Patent: May 30, 2023
    Assignee: FUJITSU LIMITED
    Inventors: Tomonori Kubota, Yasuyuki Murata
  • Patent number: 11663488
    Abstract: An online system trains a transformer architecture by an initialization method which allows the transformer architecture to be trained without normalization layers of learning rate warmup, resulting in significant improvements in computational efficiency for transformer architectures. Specifically, an attention block included in an encoder or a decoder of the transformer architecture generates the set of attention representations by applying a key matrix to the input key, a query matrix to the input query, a value matrix to the input value to generate an output, and applying an output matrix to the output to generate the set of attention representations. The initialization method may be performed by scaling the parameters of the value matrix and the output matrix with a factor that is inverse to a number of the set of encoders or a number of the set of decoders.
    Type: Grant
    Filed: February 5, 2021
    Date of Patent: May 30, 2023
    Assignee: THE TORONTO-DOMINION BANK
    Inventors: Maksims Volkovs, Xiao Shi Huang, Juan Felipe Perez Vallejo
  • Patent number: 11663489
    Abstract: A system for improved localization of image forgery. The system generates a variational information bottleneck objective function and works with input image patches to implement an encoder-decoder architecture. The encoder-decoder architecture controls an information flow between the input image patches and a representation layer. The system utilizes information bottleneck to learn useful residual noise patterns and ignore semantic content present in each input image patch. The system trains a neural network to learn a representation indicative of a statistical fingerprint of a source camera model from each input image patch while excluding semantic content thereof. The system can determine a splicing manipulation localization by the trained neural network.
    Type: Grant
    Filed: June 24, 2020
    Date of Patent: May 30, 2023
    Assignees: Insurance Services Office, Inc., The Regents of the University of Colorado
    Inventors: Aurobrata Ghosh, Steve Cruz, Terrance E. Boult, Maneesh Kumar Singh, Venkata Subbarao Veeravarasapu, Zheng Zhong
  • Patent number: 11663490
    Abstract: An example method of implementing a quantized neural network (QNN) for a programmable device includes: identifying multiply-accumulate operations of neurons in the QNN; converting the multiply-accumulate operations to memory lookup operations; and implementing the memory lookup operations using a pre-compute circuit for the programmable device, the pre-compute circuit storing a pre-computed output of a neuron in the QNN for each of the memory lookup operations.
    Type: Grant
    Filed: October 11, 2019
    Date of Patent: May 30, 2023
    Assignee: XILINX, INC.
    Inventors: Vijay Kumar Reddy Enumula, Sundeep Ram Gopal Agarwal
  • Patent number: 11663491
    Abstract: An allocation system for machine learning, comprising a terminal server and a cloud server. The terminal server is used for: acquiring demand information; generating a control instruction according to the demand information, wherein the control instruction comprises a terminal control instruction and a cloud control instruction; parsing the terminal control instruction to obtain a terminal control signal; and calculating a terminal workload of a machine learning algorithm of each stage according to the terminal control signal to obtain a terminal computation result. The cloud server is used for parsing the cloud control instruction to obtain a cloud control signal, and calculating a cloud workload of the machine learning algorithm of each stage according to the cloud control signal to obtain a cloud computation result. The terminal computation result and the cloud computation result together compose an output result.
    Type: Grant
    Filed: August 19, 2020
    Date of Patent: May 30, 2023
    Assignee: CAMBRICON TECHNOLOGIES CORPORATION LIMITED
    Inventors: Xiaofu Meng, Yongzhe Sun, Zidong Du
  • Patent number: 11663492
    Abstract: Roughly described, a problem solving platform distributes the solving of the problem over a evolvable individuals, each of which also evolves its own pool of actors. The actors have the ability to contribute collaboratively to a solution at the level of the individual, instead of each actor being a candidate for the full solution. Populations evolve both at the level of the individual and at the level of actors within an individual. In an embodiment, an individual defines parameters according to which its population of actors can evolve. The individual is fixed prior to deployment to a production environment, but its actors can continue to evolve and adapt while operating in the production environment. Thus a goal of the evolutionary process at the level of individuals is to find populations of actors that can sustain themselves and survive, solving a dynamic problem for a given domain as a consequence.
    Type: Grant
    Filed: December 21, 2017
    Date of Patent: May 30, 2023
    Assignee: Cognizant Technology Solutions
    Inventors: Babak Hodjat, Hormoz Shahrzad
  • Patent number: 11663493
    Abstract: Forecasts are provided based on dynamic model selection for different sets of time series. A model comprises a transformation and a prediction algorithm. Given a time series, a transformation is selected for the time series and a prediction algorithm is selected to make a forecast based on the transformed time series. Sets of time series are distinguished from each other based on diverse sparsities, temporal scales and other time series attributes. A model is dynamically selected based on time series attributes to increase forecasting accuracy and decrease forecasting computation time. The dynamic model selection is based on the creation of a meta-model from historical sets of historical time series.
    Type: Grant
    Filed: January 30, 2019
    Date of Patent: May 30, 2023
    Assignee: Intuit Inc.
    Inventors: Shashank Shashikant Rao, Sambarta Dasgupta, Colin Dillard
  • Patent number: 11663494
    Abstract: A method for optimizing objective functions can include selecting an objective function based at least on a hierarchy, applying parameters to the objective function to generate an output, responsive to the output not satisfying a tolerance condition, assigning a penalty to the set of parameters and evaluating a convergence condition using the set of parameters and the penalty, responsive to the output satisfying the tolerance condition, evaluating an additional objective function using the parameters in an order corresponding to the hierarchy or evaluating the convergence condition responsive to the selected objective function being a final objective function, modifying the set of parameters using a genetic algorithm responsive to the set of parameters not satisfying the convergence condition, and outputting the set of parameters responsive to the set of parameters satisfying the convergence condition.
    Type: Grant
    Filed: December 5, 2019
    Date of Patent: May 30, 2023
    Assignee: UChicago Argonne, LLC
    Inventors: Henry Chan, Mathew J. Cherukara, Badri Narayanan, Subramanian Sankaranarayanan, Stephen K. Gray, Troy David Loeffler