Patents Issued in August 10, 2021
-
Patent number: 11087165Abstract: Systems and methods for contextualizing automatic image segmentation and/or regression including defining an hourglass neural network model, which includes defining an encoder configured to generate compression layers, including a bottleneck layer, and defining a decoder including a contextual convolution operation and configured to generate one or more reconstruction layers. The contextual convolution operation includes establishing, for each of the one or more reconstruction layers, a skip connection between the reconstruction layer and prior layer(s) of different spatial dimension, e.g., between the bottleneck layer and the reconstruction layer and/or between reconstruction layers.Type: GrantFiled: July 18, 2019Date of Patent: August 10, 2021Assignee: NEC CORPORATIONInventors: Daniel Onoro-Rubio, Mathias Niepert
-
Patent number: 11087166Abstract: This application relates to the field of artificial intelligence technologies, and in particular, to a training method of an image-text matching model, a bi-directional search method, and a relevant apparatus. The training method includes extracting a global feature and a local feature of an image sample; extracting a global feature and a local feature of a text sample; training a matching model according to the extracted global feature and local feature of the image sample and the extracted global feature and local feature of the text sample, to determine model parameters of the matching model; and determining, by the matching model, according to a global feature and a local feature of an inputted image and a global feature and a local feature of an inputted text, a matching degree between the image and the text.Type: GrantFiled: September 23, 2019Date of Patent: August 10, 2021Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITEDInventors: Lin Ma, Wenhao Jiang, Wei Liu
-
Patent number: 11087167Abstract: A method is disclosed of discriminating detected objects in an area with a vision apparatus. The method includes generating image data of a portion of the area using an imaging device of the object detection device, and processing the image data to classify the image data as an imaged scene type selected from a plurality of scene types stored as scene type data in the memory. The method further includes processing the image data using the object identification data to generate object detection data for each object of the plurality of objects located in the portion of the area, each object detection data having a corresponding scene type of the plurality of scene types obtained from the object identification data, and generating user a sensible output only for the object detection data having a corresponding scene type that is the same as the imaged scene type.Type: GrantFiled: December 22, 2015Date of Patent: August 10, 2021Assignee: Robert Bosch GmbHInventors: Samarjit Das, Gonzalo Vaca, Joao P. Sousa
-
Patent number: 11087168Abstract: A method for locating text in an image is provided. Binarization processing is performed on the image, to set pixel points corresponding to text in the image to a specified color, and a binary image is obtained. A connected domain of pixels of the specified color in the binary image is detected, to obtain a candidate connected region. Connected domain candidate boundaries corresponding to a text region are extracted from the binary image, and the extracting is based on boundaries of the candidate connected region in the binary image and a text arrangement direction. The text region is obtained in the image by using the connected domain candidate boundaries.Type: GrantFiled: October 15, 2019Date of Patent: August 10, 2021Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LTDInventors: Kun Xiong, Jian Ye Chen
-
Patent number: 11087169Abstract: An image processing apparatus includes an image feature extraction unit configured to extract an image feature from an input image, a region extraction unit configured to extract a foreground region from the input image based on the image feature, an acquisition unit configured to acquire correction information based on the image feature, a correction unit configured to correct the foreground region using the correction information, an identification feature extraction unit configured to extract a feature for identification from the foreground region corrected by the correction unit, and an identification unit configured to identify an object in the input image based on the feature for the identification.Type: GrantFiled: January 4, 2019Date of Patent: August 10, 2021Assignee: Canon Kabushiki KaishaInventors: Hiroyuki Uchiyama, Hiroshi Tojo, Kotaro Yano
-
Patent number: 11087170Abstract: A generator for generating artificial data, and training for the same. Data corresponding to a first label is altered within a reference labeled data set. A discriminator is trained based on the reference labeled data set to create a selectively poisoned discriminator. A generator is trained based on the selectively poisoned discriminator to create a selectively poisoned generator. The selectively poisoned generator is tested for the first label and tested for the second label to determine whether the generator is sufficiently poisoned for the first label and sufficiently accurate for the second label. If it is not, the generator is retrained based on the data set including the further altered data. The generator includes a first ANN to input first information and output a set of artificial data that is classifiable using a first label and not classifiable using a second label of the set of labeled data.Type: GrantFiled: December 3, 2018Date of Patent: August 10, 2021Assignee: ADVANCED MICRO DEVICES, INC.Inventor: Nicholas Malaya
-
Patent number: 11087171Abstract: A system for assessing and/or adapting an image recorded with a camera, based on a deep neural network. The deep neural network undergoes a training, the training of the deep neural network is carried out based on a loss function as a metric, the loss function is based on a structural similarity index, and the structural similarity index in the training is ascertained based on at least one input image of the underlying camera, an output image of the deep neural network, and in particular an adaptation method via the deep neural network and a target image as default.Type: GrantFiled: August 16, 2019Date of Patent: August 10, 2021Assignee: Robert Bosch GmbHInventors: Peter Korosi-Szabo, Attila Borcs, Kornel Istvan Kis, Levente Kis
-
Patent number: 11087172Abstract: Training images can be synthesized in order to obtain enough data to train a model (e.g., a neural network) to recognize various classifications of a type of object. Images can be synthesized by blending images of objects labeled using those classifications into selected background images. To improve results, one or more operations are performed to determine whether the synthesized images can still be used as training data, such as by verifying one or more objects of interested represented in those images is not occluded, or at least satisfies a threshold level of acceptance. The training images can be used with real world images to train the model.Type: GrantFiled: December 31, 2020Date of Patent: August 10, 2021Assignee: Plus One Robotics, Inc.Inventors: Jonathan Lwowski, Abhijit Majumdar
-
Patent number: 11087173Abstract: Systems and processes can reduce an amount of training data used to generate a machine learning model while maintaining or improving a resultant of the machine learning model. The amount of training data may be reduced by pre-processing the training data to normalize the training data. The training data may include images of portions of an elongated object, such as a road. Each of the images can be normalized by, for example, rotating each of the images such that the depicted roads are horizontal or otherwise share the same angle. By aligning disparate images of roads, it is possible to reduce the amount of training data and to increase the accuracy of the machine learning model. Further, the use of normalized images by the machine learning model enables a reduction in computing resources used to apply data to the machine learning model to, for example, identify lane markings within images.Type: GrantFiled: December 27, 2018Date of Patent: August 10, 2021Assignee: Beijing DiDi Infinity Technology and Development Co., Ltd.Inventors: Tingbo Hou, Yan Zhang
-
Patent number: 11087174Abstract: A method is provided for visual inspection. The method includes learning, by a processor, group disentangled visual feature embedding vectors of input images. The input images include defective objects and defect-free objects. The method further includes generating, by the processor using a weight generation network, classification weights from visual features and semantic descriptions. Both the visual features and the semantic descriptions are for predicting defective and defect-free labels. The method also includes calculating, by the processor, a cosine similarity score between the classification weights and the group disentangled visual feature embedding vectors. The method additionally includes episodically training, by the processor, the weight generation network on the input images to update parameters of the weight generation network.Type: GrantFiled: September 24, 2019Date of Patent: August 10, 2021Inventors: Renqiang Min, Kai Li, Bing Bai, Hans Peter Graf
-
Patent number: 11087175Abstract: A method for learning a recurrent neural network to check an autonomous driving safety to be used for switching a driving mode of an autonomous vehicle is provided. The method includes steps of: a learning device (a) if training images corresponding to a front and a rear cameras of the autonomous vehicle are acquired, inputting each pair of the training images into corresponding CNNs, to concatenate the training images and generate feature maps for training, (b) inputting the feature maps for training into long short-term memory models corresponding to sequences of a forward RNN, and into those corresponding to the sequences of a backward RNN, to generate updated feature maps for training and inputting feature vectors for training into an attention layer, to generate an autonomous-driving mode value for training, and (c) allowing a loss layer to calculate losses and to learn the long short-term memory models.Type: GrantFiled: December 20, 2019Date of Patent: August 10, 2021Assignee: Stradvision, Inc.Inventors: Kye-Hyeon Kim, Yongjoong Kim, Hak-Kyoung Kim, Woonhyun Nam, SukHoon Boo, Myungchul Sung, Dongsoo Shin, Donghun Yeo, Wooju Ryu, Myeong-Chun Lee, Hyungsoo Lee, Taewoong Jang, Kyungjoong Jeong, Hongmo Je, Hojin Cho
-
Patent number: 11087176Abstract: A synthetic world interface may be used to model digital environments, sensors, and motions for the evaluation, development, and improvement of localization algorithms. A synthetic data cloud service with a library of sensor primitives, motion generators, and environments with procedural and game-like capabilities, facilitates engineering design for a manufactural solution that has localization capabilities. In some embodiments, a sensor platform simulator operates with a motion orchestrator, an environment orchestrator, an experiment generator, and an experiment runner to test various candidate hardware configurations and localization algorithms in a virtual environment, advantageously speeding development and reducing cost. Thus, examples disclosed herein may relate to virtual reality (VR) or mixed reality (MR) implementations.Type: GrantFiled: May 8, 2018Date of Patent: August 10, 2021Assignee: Microsoft Technology Licensing, LLCInventors: Michael Ebstyne, Pedro Urbina Escos, Emanuel Shalev, Alex Kipman, Yuri Pekelny, Jonathan Chi Hang Chan
-
Patent number: 11087177Abstract: Approaches to zero-shot learning include partitioning training data into first and second sets according to classes assigned to the training data, training a prediction module based on the first set to predict a cluster center based on a class label, training a correction module based on the second set and each of the class labels in the first set to generate a correction to a cluster center predicted by the prediction module, presenting a new class label for a new class to the prediction module to predict a new cluster center, presenting the new class label, the predicted new cluster center, and each of the class labels in the first set to the correction module to generate a correction for the predicted new cluster center, augmenting a classifier based on the corrected cluster center for the new class, and classifying input data into the new class using the classifier.Type: GrantFiled: October 31, 2018Date of Patent: August 10, 2021Assignee: salesforce.com, inc.Inventors: Lily Hu, Caiming Xiong, Richard Socher
-
Patent number: 11087178Abstract: An online system may identify content with which a user has an interest. For example, the online system may determine that a user has an interest in the content based on interaction information indicating that the user interacted with the content. In a particular example, the online system may identify image concepts included in the content based on computer vision techniques that recognize the image concepts. The online system may model probabilities that image concepts will appeal to users. Based on the modeled probabilities, the online system may automatically recommend image concepts for inclusion in candidate images, automatically generate candidate images, or assess candidate images to determine a probability of user interaction with the assessed candidate images.Type: GrantFiled: April 12, 2019Date of Patent: August 10, 2021Assignee: FACEBOOK, INC.Inventors: Barak R. Naveh, James Reyes
-
Patent number: 11087179Abstract: The technology disclosed includes a system to perform multi-label support vector machine (SVM) classification of a document. The system creates document features representing frequencies or semantics of words in the document. Trained SVM classification parameters for a plurality of labels are applied to the document features for the document. The system determines positive and negative distances between SVM hyperplanes for the labels and the feature vector. Labels with positive distance to the feature vector are harvested. When the distribution of negative distances is characterized by a mean and standard deviation, the system further harvests the labels with a negative distance such that the harvested labels include the labels with a negative distance between the mean negative distance and zero and separated from the mean negative distance by a predetermined first number of standard deviations.Type: GrantFiled: December 19, 2018Date of Patent: August 10, 2021Assignee: Netskope, Inc.Inventors: Sandeep Yadav, Ravindra K. Balupari
-
Patent number: 11087180Abstract: A feature extraction is performed on transaction data to obtain a user classification feature and a transaction classification feature. A first dimension feature is constructed based on the user classification feature and the transaction classification feature. A dimension reduction processing is performed on the first dimension feature to obtain a second dimension feature. A probability that the transaction data relates to a risky transaction is determined based on a decision classification of the second dimension feature, where the decision classification is based on a pre-trained deep forest network including a plurality of levels of decision tree forest sets.Type: GrantFiled: February 27, 2020Date of Patent: August 10, 2021Assignee: Advanced New Technologies Co., Ltd.Inventors: Wenhao Zheng, Yalin Zhang, Longfei Li
-
Patent number: 11087181Abstract: A location of an object of interest (205) is determined using both observations and non-observations. Numerous images (341-345) are stored in a database in association with image capture information, including an image capture location (221-225). Image recognition is used to determine which of the images include the object of interest (205) and which of the images do not include the object of interest. For each of multiple candidate locations (455) within an area of the captured images, a likelihood value of the object of interest existing at the candidate location is calculated using the image capture information for images determined to include the object of interest and using the image capture information for images determined not to include the object of interest. The location of the object is determined using the likelihood values for the multiple candidate locations.Type: GrantFiled: May 24, 2017Date of Patent: August 10, 2021Assignee: Google LLCInventor: Michael Greene
-
Patent number: 11087182Abstract: An image recognition approach employs both computer generated and manual image reviews to generate image tags characterizing an image. The computer generated and manual image reviews can be performed sequentially or in parallel. The generated image tags may be provided to a requester in real-time, be used to select an advertisement, and/or be used as the basis of an internet search. In some embodiments generated image tags are used as a basis for an upgraded image review. A confidence of a computer generated image review may be used to determine whether or not to perform a manual image review. Images and their associated image tags are optionally added to an image sequence.Type: GrantFiled: December 12, 2018Date of Patent: August 10, 2021Assignee: CLOUDSIGHT, INC.Inventors: Bradford A Folkens, Dominik K Mazur
-
Patent number: 11087183Abstract: A method and system of multi-modality classification using augmented data is disclosed. The method includes generating a pattern for each of a plurality of augmented data associated with each of a plurality of object classes, based on at least one modality associated with each of the plurality of objects classes using a Long Term Short Memory (LSTM) classifier and a Layer-wise Relevance Propagation (LRP). The method further includes classifying an input image into a first object class of the plurality of object classes based on one or more objects within the input image using a Convolution Neural Network (CNN). The method further includes re-classifying the input image into one of the first object class or a second object class of the plurality of object classes when the accuracy of classification by the CNN into the first object class is below a matching threshold.Type: GrantFiled: August 14, 2019Date of Patent: August 10, 2021Assignee: Wipro LimitedInventors: Manjunath Ramachandra Iyer, Sethuraman Ulaganathan
-
Patent number: 11087184Abstract: A computer-implemented method and system are provided for training a model for New Class Categorization (NCC) of a test image. The method includes decoupling, by a hardware processor, a feature extraction part from a classifier part of a deep classification model by reparametrizing learnable weight variables of the classifier part as a combination of learnable variables of the feature extraction part and of a classification weight generator of the classifier part. The method further includes training, by the hardware processor, the deep classification model to obtain a trained deep classification model by (i) learning the feature extraction part as a multiclass classification task, and (ii) episodically training the classifier part by learning a classification weight generator which outputs classification weights given a training image.Type: GrantFiled: September 24, 2019Date of Patent: August 10, 2021Inventors: Renqiang Min, Kai Li, Bing Bai, Hans Peter Graf
-
Patent number: 11087185Abstract: A method and apparatus for adjusting a neural network that classifies a scene of an input image into at least one class is provided. The method generates a feature image having a size that is less than a size of an input image by applying a convolutional network to the input image, determines at least one class corresponding to the feature image, generates a class image having a size corresponding to the size of the input image by applying a deconvolutional network to the feature image, calculates a loss of the class image based on a verification class image preset with respect to the input image, and adjusts the neural network based on the loss.Type: GrantFiled: May 20, 2019Date of Patent: August 10, 2021Assignee: Samsung Electronics Co., Ltd.Inventors: Cheolhun Jang, Dokwan Oh, Dae Hyun Ji
-
Patent number: 11087186Abstract: The disclosure extends to methods, systems, and apparatuses for automated fixation generation and more particularly relates to generation of synthetic saliency maps. A method for generating saliency information includes receiving a first image and an indication of one or more sub-regions within the first image corresponding to one or more objects of interest. The method includes generating and storing a label image by creating an intermediate image having one or more random points. The random points have a first color in regions corresponding to the sub-regions and a remainder of the intermediate image having a second color. Generating and storing the label image further includes applying a Gaussian blur to the intermediate image.Type: GrantFiled: October 18, 2019Date of Patent: August 10, 2021Assignee: FORD GLOBAL TECHNOLOGIES, LLCInventors: Madeline Jane Schrier, Vidya Nariyambut Murali
-
Patent number: 11087187Abstract: System and method for improving recognition of characters. A system for improving recognition of characters is disclosed. The system comprises at least one processor (10), configured to receive an image (1004) of an article (102) comprising characters to be recognized. The system (100) displays characters as recognized on a display screen (1006). Further, the system (100) is configured to receive user feedback comprising correction of an error made by the system (100) in recognizing at least one character and provide a system feedback comprising display of images or textual descriptions of one or more variants (1012, 1014, 1016, 1018, 1020, 1022) of a character, which is incorrectly recognized by the system, which enables the natural person to adapt writing style to enable better quality inputs to the recognition module. The article (102) is a handwritten paper form (102), filled and captured by the natural person.Type: GrantFiled: February 18, 2020Date of Patent: August 10, 2021Assignee: LOGISTIMO INDIA PRIVATE LIMITEDInventors: Chandrakant Meena, Arun Ramanujapuram
-
Patent number: 11087188Abstract: Methods and apparatus for decoding data streams are provided. A computing device can receive a decoder-input data stream encoded in a decoder-input format. The decoder-input data stream can include one or more pages of content. The decoder-input data stream can be initiated by an identifier identifying the decoder-input format (which may be the same as an encoder-output format) and a lookup table. The lookup table can reference objects within the decoder-input data stream and can specify locations of each of the one or more pages within the decoder-input data stream. The computing device can generate an output based on the decoder-input data stream.Type: GrantFiled: September 30, 2019Date of Patent: August 10, 2021Assignee: KYOCERA Document Solutions Inc.Inventors: Duc Phu Truong, Neil-Paul Payoyo Bermundo, Mohamed El Sayed Mostafa
-
Patent number: 11087189Abstract: A power supply apparatus includes a clock signal generating unit that generates a clock signal with a clock frequency, a calculating unit that calculates a frequency at which a first frequency, a second frequency, and a third frequency are synchronized based on the clock frequency, an AC voltage output unit that outputs an AC voltage of the second frequency based on a signal of the first frequency, a DC voltage output unit outputting a DC voltage based on a signal of the third frequency, and an output unit that outputs based on the AC voltage and the DC voltage.Type: GrantFiled: January 21, 2020Date of Patent: August 10, 2021Assignee: Ricoh Company, Ltd.Inventor: Tsuyoshi Mano
-
Patent number: 11087190Abstract: An information processing apparatus obtains capability information of a printing apparatus, wherein the capability information is including a predetermined text and a sheet type that the printing apparatus can use in printing; displays, in a display unit, a first option that the printing apparatus carries out printing for a sheet of a selected sheet type, based on the predetermined text included in the capability information, and displays a second option that the printing apparatus carries out printing for a sheet of the sheet type included in the capability information based on the sheet type included in the capability information; generates a print job including the option set through the screen; and sends the generated print job to the printing apparatus.Type: GrantFiled: January 22, 2020Date of Patent: August 10, 2021Assignee: CANON KABUSHIKI KAISHAInventors: Yasunori Kanai, Kenta Matsui
-
Patent number: 11087191Abstract: A method may include with a raster image processor, creating pretreatment plane rasterized image data from source image data and, with a plasma emitter, selectively applying a plasma treatment to a surface of a print media based on the pre-treatment plane rasterized image data. A printing device may include a raster image processor to execute an image analysis module to create pre-treatment plane rasterized image data from source image data and a plasma emitting device to selectively apply a plasma treatment to a surface of a print media based on the pre-treatment plane rasterized image data.Type: GrantFiled: March 7, 2018Date of Patent: August 10, 2021Assignee: Hewlett-Packard Development Company, L.P.Inventors: Frank Perdicaro, Tracy A. Lang, Thomas A. Saksa
-
Patent number: 11087192Abstract: A piece of equipment that needs services may not have connectivity to a network. In an example method, an event triggers the piece of equipment to generate a barcode or QR code. The event may be installation of equipment, preventive maintenance, update of software, periodic calibration, abnormal operation, change of location, etc. The barcode or QR code contains information of the piece of equipment and the triggering event. The piece of equipment halts upon display of the barcode or QR code. An application installed in a user device scans the barcode or QR code and sends a message to a remote service center. The service center analyzes the message and updates a service database. The service center returns a key in a message back to the user device. When the key is input into the piece of equipment, the operation of the piece of equipment is resumed.Type: GrantFiled: May 8, 2018Date of Patent: August 10, 2021Assignee: General Electric CompanyInventor: Gil Amisar
-
Patent number: 11087193Abstract: A transaction card construction and a method for making transaction cards provides increased security for transaction card magnetic strips. The transaction card construction includes a card inlay and a clear card body. The card inlay is formed via a lamination press process with the magnetic strip attached to a back surface of the card inlay. The card body may have a window through which a data storage element may be exposed for accessing, such as by a magnetic stripe reader or EMV chip reader. The card body may be formed by adhering the card inlay to the clear card body.Type: GrantFiled: May 21, 2020Date of Patent: August 10, 2021Assignee: Capital One Services, LLCInventor: Om J. Suthar
-
Patent number: 11087194Abstract: The invention relates to a smart card that includes an integrated keypad made with a piezoelectric material. A user can press the keypad to generate an electrical signal. A sequence of signals corresponding to a user's personal identification number can be sent to an integrated circuit chip or otherwise compared against a stored PIN to determine if the user has entered the correct PIN.Type: GrantFiled: November 9, 2020Date of Patent: August 10, 2021Assignee: The United States of America, as represented by the Secretary of the NavyInventor: Donald J. Lane
-
Patent number: 11087195Abstract: Memory cards having a nano card form factor configured according to different card standards. The nano card have a pair of opposed surfaces having a length and width of a nano SIM card in which a first group of interface pads on one of the opposed surfaces configured to mate with contact pins of a host device card slot operating per a PCIe memory card standard and a second group of interface pads configured to mate with contact pins of a host device card slot operating per a second memory card standard different than the PCIe memory card standard. The nano cards have patterns of pads allowing for vertical and horizontal insertion to a host device card slot being backward compatible with legacy host device card slots.Type: GrantFiled: April 4, 2019Date of Patent: August 10, 2021Assignee: Western Digital Technologies, Inc.Inventors: Yoseph Pinto, Shajith Musaliar Sirajudeen
-
Patent number: 11087196Abstract: Disclosed herein are an installation assembly (1), an instrument (2) and an installation method for a radio frequency identification tag. The installation assembly (1) comprises a first housing unit (11) mounted on the instrument (2) and a second housing unit (14) snapped-fitted with the first housing unit (11) to form a receiving space for receiving the radio frequency identification tag (13). The radio frequency identification tag (13) can be easily installed on the instrument (2) by snapping-fitting the first housing unit (11) with the second housing unit (14), thereby effectively enhancing installation efficiency and reliability of the radio frequency identification tag (13).Type: GrantFiled: January 21, 2020Date of Patent: August 10, 2021Assignee: XERAFY (SHANGHAI) CO., LTD.Inventors: Linlin Huang, Zhijia Liu
-
Patent number: 11087197Abstract: An attention tag for a retail article that includes a label having an adhesive region bonded to a retail article and a protruding region that protrudes from the retail article when the label is attached thereto. Moreover, an RFID tag is disposed on the label and includes an RFIC element and an antenna pattern including first and second antenna portions that are respectively connected to first and second ends of the RFIC element. Moreover, the first antenna portion is disposed in the protruding region of the label while the second antenna portion of the RFID tag is disposed in the adhesive region of the label at a position facing a portion of the retail article.Type: GrantFiled: December 27, 2018Date of Patent: August 10, 2021Assignee: MURATA MANUFACTURING CO., LTD.Inventors: Ikuhei Kimura, Noboru Kato, Kunihiro Komaki
-
Patent number: 11087198Abstract: Disclosed herein is a miniaturized dual-resonance anti-metal RFID tag, comprising a dielectric substrate and a microstrip antenna disposed on the surface of the dielectric substrate. The microstrip antenna comprises a first electrode and a second electrode disposed on the front surface of the dielectric substrate with a first slit disposed therebetween, a grounding electrode disposed on the back surface of the dielectric substrate, a feeding electrode disposed on the first side of the dielectric substrate and comprising a first feeding electrode and a second feeding electrode with a second slit disposed therebetween, and wherein: a driving chip is disposed at the second slit, which is coupled to the first and the second feeding electrodes respectively, the first feeding electrode is coupled to the second electrode, the second feeding electrode is coupled to the grounding electrode.Type: GrantFiled: April 14, 2020Date of Patent: August 10, 2021Assignee: XERAFY (SHANGHAI) CO., LTD.Inventor: Lutao Zhou
-
Patent number: 11087199Abstract: A context-aware attention-based neural network is provided for answering an input question given a set of purportedly supporting statements for the input question. The neural network includes a processing element. The processing element is configured to calculate a question representation for the input question, based on word annotations and word-level attentions calculated for the input question. The processing element is further configured to calculate a sentence representation for each of the purportedly supporting statements, based on word annotations and word-level attentions calculated for each of the purportedly supporting statements. The processing element is also configured to calculate a context representation for the set of purportedly supporting statements with respect to the sentence representation for each of the purportedly supporting statements.Type: GrantFiled: October 20, 2017Date of Patent: August 10, 2021Inventors: Renqiang Min, Asim Kadav, Huayu Li
-
Patent number: 11087200Abstract: In Multi-Policy Decision-Making (MPDM), many computationally-expensive forward simulations are performed in order to predict the performance of a set of candidate policies. In risk-aware formulations of MPDM, only the worst outcomes affect the decision making process, and efficiently finding these influential outcomes becomes the core challenge. Recently, stochastic gradient optimization algorithms, using a heuristic function, were shown to be significantly superior to random sampling. In this disclosure, it was shown that accurate gradients can be computed-even through a complex forward simulation—using approaches similar to those in dep networks. The proposed approach finds influential outcomes more reliably, and is faster than earlier methods, allowing one to evaluate more policies while simultaneously eliminating the need to design an easily-differentiable heuristic function.Type: GrantFiled: March 16, 2018Date of Patent: August 10, 2021Assignee: THE REGENTS OF THE UNIVERSITY OF MICHIGANInventors: Edwin Olson, Dhanvin H. Mehta, Gonzalo Ferrer
-
Patent number: 11087201Abstract: A method for determining an architecture for a task neural network configured to perform a particular machine learning task is described.Type: GrantFiled: April 29, 2020Date of Patent: August 10, 2021Assignee: Google LLCInventors: Wei Hua, Barret Zoph, Jonathon Shlens, Chenxi Liu, Jonathan Huang, Jia Li, Fei-Fei Li, Kevin Patrick Murphy
-
Patent number: 11087202Abstract: A method and system of targeting information for a user is provided. The method includes collecting one or more digital posts that identify a product and are associated with a digital account, identifying, by a neural network, a stage of a decision model associated with each of the one or more digital posts based on a feature representation generated for each digital post, and transmitting product-related information to the digital account, wherein the transmitting is based on the stage of the decision model identified for each of the one or more digital posts.Type: GrantFiled: February 28, 2017Date of Patent: August 10, 2021Assignee: FUJIFILM BUSINESS INNOVATION CORP.Inventors: Heike Adel, Francine Chen, Yin-Ying Chen
-
Patent number: 11087203Abstract: The present application discloses a method and apparatus for processing a data sequence. A specific implementation of the method includes: receiving an inputted to-be-processed data sequence; copying a weight matrix in a recurrent neural network model to an embedded block random access memory (RAM) of a field-programmable gate array (FPGA); processing sequentially each piece of to-be-processed data in the to-be-processed data sequence by using an activation function in the recurrent neural network model and the weight matrix stored in the embedded block RAM; and outputting a processed data sequence corresponding to the to-be-processed data sequence. This implementation improves the data sequence processing efficiency of the recurrent neural network model.Type: GrantFiled: June 9, 2017Date of Patent: August 10, 2021Assignee: Beijing Baidu Netcom Science and Technology, Co., LtdInventors: Yong Wang, Jian Ouyang, Wei Qi, Sizhong Li
-
Patent number: 11087204Abstract: Embodiments of the present invention include a crossbar array that includes a resistive processing unit (RPU) device at each crosspoint in the crossbar array. The RPU device includes a single weight storage element, and multiple weight reader elements. A first weight reader element is coupled with a first row wire to compute a first matrix product value using a first value and a stored value, the first value being transmitted via the first row wire and the stored value being stored in the single weight storage element. A second weight reader element is coupled with a second row wire to compute a second matrix product value of a second value and said stored value, the second value being transmitted via the second row wire.Type: GrantFiled: April 20, 2018Date of Patent: August 10, 2021Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Tayfun Gokmen, Wilfried Haensch, Seyoung Kim
-
Patent number: 11087205Abstract: A neural network that may include multiple layers of neural cells; wherein a certain neural cell of a certain layer of neural cells may include a first plurality of one-bit inputs; an adder and leaky integrator unit; and an activation function circuit that has a one-bit output; wherein the first plurality of one-bit inputs are coupled to a first plurality of one-bit outputs of neural cells of a layer that precedes the certain layer; wherein the adder and leaky integration unit is configured to calculate a leaky integral of a weighted sum of a number of one-bit pulses that were received, during a time window, by the first plurality of one-bit inputs; and wherein the activation function circuit is configured to apply an activation function on the leaky integral to provide a one-bit output of the certain neural cell.Type: GrantFiled: January 23, 2018Date of Patent: August 10, 2021Assignee: DSP GROUP LTD.Inventor: Moshe Haiut
-
Patent number: 11087206Abstract: A mechanism is described for facilitating memory handling and data management in machine learning at autonomous machines. A method of embodiments, as described herein, includes detecting multiple tables associated with multiple neural networks at multiple autonomous machines, where each of the multiple tables include an index. The method may further include combining the multiple tables and multiple indexes associated with the multiple tables into a single table and a single index, respectively, where the single table is communicated to the multiple autonomous machines to allow simultaneous processing of one or more portions of the single table using one or more memory devices and one or more processors of one or more of the multiple autonomous machines.Type: GrantFiled: April 28, 2017Date of Patent: August 10, 2021Assignee: INTEL CORPORATIONInventors: Tomer Schwartz, Ehud Cohen, Uzi Sarel, Amitai Armon, Yaniv Fais, Lev Faivishevsky, Amit Bleiweiss, Yahav Shadmiy, Jacob Subag
-
Patent number: 11087207Abstract: Numerous embodiments of decoders for use with a vector-by-matrix multiplication (VMM) array in an artificial neural network are disclosed. The decoders include bit line decoders, word line decoders, control gate decoders, source line decoders, and erase gate decoders. In certain embodiments, a high voltage version and a low voltage version of a decoder is used.Type: GrantFiled: May 29, 2018Date of Patent: August 10, 2021Assignee: SILICON STORAGE TECHNOLOGY, INC.Inventors: Hieu Van Tran, Stanley Hong, Anh Ly, Thuan Vu, Hien Pham, Kha Nguyen, Han Tran
-
Patent number: 11087208Abstract: An analog neuromorphic circuit is disclosed having resistive memories that provide a resistance to each corresponding input voltage signal. Input voltages are applied to the analog neuromorphic circuit. Each input voltage represents a vector value that is a non-binary value included in a vector that is incorporated into a dot-product operation with weighted matrix values included in a weighted matrix. A controller pairs each resistive memory with another resistive memory. The controller converts each pair of resistance values to a single non-binary value. Each single non-binary value is mapped to a weighted matrix value included in the weighted matrix that is incorporated into the dot-product operation with the vector values included in the vector. The controller generates dot-product operation values from the dot-product operation with the vector and the weighted matrix where each dot-product operation is a non-binary value.Type: GrantFiled: September 29, 2020Date of Patent: August 10, 2021Assignee: University of DaytonInventors: Chris Yakopcic, Tarek M. Taha, Md Raqibul Hasan
-
Patent number: 11087209Abstract: Systems and methods for using collecting and analyzing device sensor data to determine whether an individual is an operator or a passenger of a vehicle are disclosed. According to certain aspects, an electronic device associated with the individual may collect or access sensor data that is indicative of or associated with an operation of the vehicle. The electronic device may transmit pertinent portion(s) of the sensor data to a backend server, which may input the portion(s) into a neural network for analysis. The neural network may output a probability metric(s) indicative of whether the individual is a passenger or an operator of the vehicle.Type: GrantFiled: July 21, 2017Date of Patent: August 10, 2021Assignee: BlueOwl, LLCInventors: Vinay Kumar, Kenneth J. Sanchez
-
Patent number: 11087210Abstract: A method of operating a health tracking system is disclosed. The method comprises: receiving a first data record comprising at least a first descriptive string regarding a consumable item, the first descriptive string having at least one word thereof incorrectly spelled; generating a vector using the first descriptive string using a machine learning model; identifying a second descriptive string which corresponds to the consumable item and which has a correct spelling of the at least one incorrectly spelled word by applying the machine learning model to the generated vector; calculating a confidence factor regarding the identified second descriptive string using the machine learning model; and when it is determined that the confidence factor exceeds a predetermined threshold, (i) modifying the first data record by replacing the first descriptive string with the second descriptive string, and (ii) storing the modified first data record in the database.Type: GrantFiled: August 18, 2017Date of Patent: August 10, 2021Assignee: MyFitnessPal, Inc.Inventors: Wenzhe Xue, Hesamoddin Salehian, Patrick Howell
-
Patent number: 11087211Abstract: The technology disclosed determines one or more field values in a set of field values for a particular field in a fielded dataset that are similar to an input value using six similarity measures. A factor vector is generated per similarity measure and combined to form an input matrix. A convolutional neural network processes the input matrix to generate evaluation vectors. A fully-connected network evaluates the evaluation vectors to generate suggestion scalars for similarity to a particular input value. Thresholding is applied to suggestions scalars to determine one or more suggestion candidates for the particular input value.Type: GrantFiled: October 5, 2017Date of Patent: August 10, 2021Assignee: salesforce.com, inc.Inventors: Chang Lu, Lingtao Zhang
-
Patent number: 11087212Abstract: In one embodiment, the present invention provides a neural network comprising multiple modalities. Each modality comprises multiple neurons. The neural network further comprises an interconnection lattice for cross-associating signaling between the neurons in different modalities. The interconnection lattice includes a plurality of perception neuron populations along a number of bottom-up signaling pathways, and a plurality of action neuron populations along a number of top-down signaling pathways. Each perception neuron along a bottom-up signaling pathway has a corresponding action neuron along a reciprocal top-down signaling pathway. An input neuron population configured to receive sensory input drives perception neurons along a number of bottom-up signaling pathways. A first set of perception neurons along bottom-up signaling pathways drive a first set of action neurons along top-down signaling pathways.Type: GrantFiled: February 28, 2019Date of Patent: August 10, 2021Assignee: International Business Machines CorporationInventor: Dharmendra S. Modha
-
Patent number: 11087213Abstract: A classification training system for binary and multi-class classification comprises a neural network operable to perform classification of input data, a training dataset including pre-segmented, labeled training samples, and a classification training module operable to train the neural network using the training dataset. The classification training module includes a forward pass processing module, and a backward pass processing module. The backward pass processing module is operable to determine whether a current frame is in a region of target (ROT), determine ROT information such as beginning and length of the ROT and update weights and biases using a cross-entropy cost function and One Spike Connectionist Temporal Classification (OSCTC) cost function. The backward pass module further computes a soft target value using ROT information and computes a signal output error using the soft target value and network output value.Type: GrantFiled: December 20, 2019Date of Patent: August 10, 2021Assignee: SYNAPTICS INCORPORATEDInventors: Saeed Mosayyebpour, Trausti Thormundsson, Francesco Nesta
-
Patent number: 11087214Abstract: In one aspect, the invention comprises a system for control of a transaction state system utilizing a distributed ledger. First, the system includes an application plane layer adapted to receive instructions regarding operation of the transaction state system. Preferably, the application plane layer is coupled to the application plane layer interface. Second, a control plane layer is provided, the control plane layer including an adaptive control unit, such as a cognitive computing unit, artificial intelligence unit or machine-learning unit. Third, a data plane layer includes an input interface to receive data input from one or more data sources and to provide output coupled to a decentralized distributed ledger, the data plane layer is coupled to the control plane layer. Optionally the decentralized distributed ledger stores data on cryptocurrency.Type: GrantFiled: January 21, 2021Date of Patent: August 10, 2021Assignee: MILESTONE ENTERTAINMENT, LLCInventors: Randall M. Katz, Robert Tercek