Patents Examined by Vikkram Bali
  • Patent number: 11158064
    Abstract: The present invention falls within the technical field of robots, and particularly relates to a robot monitoring system. The robot monitoring system based on human body information comprises an image collection unit for collecting an image; a human body detection unit for determining whether human body information matching a training sample exists in the image; a target acquisition unit for acquiring position information and size information about the human body information in the image; a target tracking unit for acquiring a current motion region according to a frame difference between the image and a predetermined image frame and acquiring a moving target from the motion region; and an adjustment unit for adjusting the orientation of the image collection unit such that the moving target is located in the centre of the image.
    Type: Grant
    Filed: February 20, 2017
    Date of Patent: October 26, 2021
    Assignee: YOTOU TECHNOLOGY (HANGZHOU) CO., LTD.
    Inventor: Mingxiu Chen
  • Patent number: 11151382
    Abstract: Image processing of an image is used to determine the opportunity to view an object. Rather than relying on simple numbers passing an object, the opportunity to view the object is weighted based on attention, which is derived from other objects competing for attention. For the processor to more accurately determine opportunity to view as compared to using geometric information alone, a machine-learned network is used. To deal with changes in obstructions, another machine-learned network may extract obstructions from camera images. Trace data is used to allow for daily variation in base counts of viewers, allowing greater temporal resolution and determination based on information more recently acquired than counts.
    Type: Grant
    Filed: April 6, 2020
    Date of Patent: October 19, 2021
    Assignee: BILLUPS, INC.
    Inventor: Shawn Spooner
  • Patent number: 11138741
    Abstract: A method and system for monitoring the motion of one or both eyes, includes capturing a sequence of overlapping images of a subject's face including an eye and the corresponding non-eye region; identifying a plurality of keypoints in each image; mapping corresponding keypoints in two or more images of the sequence; assigning the keypoints to the eye and to the corresponding non-eye region; calculating individual velocities of the corresponding keypoints in the eye and the corresponding non-eye region to obtain a distribution of velocities; extracting at least one velocity measured for the eye and at least one velocity measured for the corresponding non-eye region; calculating the eye-in-head velocity for the eye based upon the measured velocity for the eye and the measured velocity for the corresponding non-eye region; and calculating the eye-in-head position based upon the eye-in-head velocity.
    Type: Grant
    Filed: May 26, 2017
    Date of Patent: October 5, 2021
    Assignee: Rochester Institute of Technology
    Inventors: Jeff B. Pelz, Dan Witzner Hansen
  • Patent number: 11138456
    Abstract: A method and system are provided for ensuring creation of authentic online profiles. The method includes providing an option to a user for enabling capturing of digital media depicting the user's appearance. Further, digital media using a camera associated with a user device is captured, if the user chooses to allow the capturing of digital media. Furthermore, at least one instruction is communicated to the user for performing one or more actions. Subsequently, the captured digital media is transmitted for verification, without allowing the user to modify the captured digital media. Thereafter, the captured digital media is verified by analyzing the captured digital media for approving or rejecting the captured digital media.
    Type: Grant
    Filed: July 12, 2013
    Date of Patent: October 5, 2021
    Inventor: Brandon Wey
  • Patent number: 11127164
    Abstract: A controller for executing a task based on probabilistic image-based landmark localization, uses a neural network, which is trained to process images of objects of a type having a structured set of landmarks to produce a parametric probability distribution defined by values of parameters for a location of each landmark in each processed image. The controller submits the set of input images to the neural network to produce the values of the parameters that define the parametric probability distribution over the location of each landmark in the structured set of landmarks of each input image. Further, the controller determines, for each input image, a global landmark uncertainty for the image based on the parametric probability distributions of landmarks in the input image and executes the task based on the parametric probability distributions of landmarks in each input image and the global landmark uncertainty of each input image.
    Type: Grant
    Filed: October 4, 2019
    Date of Patent: September 21, 2021
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Tim Marks, Abhinav Kumar, Wenxuan Mou, Chen Feng, Xiaoming Liu
  • Patent number: 11120305
    Abstract: There is a desire to accurately learn a detection model. Provided is a computer-implemented method including acquiring an input image; acquiring an annotated image designating a region of interest in the input image; inputting the input image to a detection model that generates an output image showing a target region from the input image; calculating an error between the output image and the annotated image, using a loss function that weights an error inside the region of interest more heavily than an error outside the region of interest; and updating the detection model in a manner to reduce the error.
    Type: Grant
    Filed: July 10, 2019
    Date of Patent: September 14, 2021
    Assignee: International Business Machines Corporation
    Inventors: Takuya Goto, Hiroki Nakano, Masaharu Sakamoto
  • Patent number: 11112535
    Abstract: An atmospheric precipitation rate computation system, comprising an electronic digital image/video capture apparatus to capture digital images/videos of an environment in which an atmospheric precipitation is taking place; an electronic digital image processing apparatus connected to the electronic digital image/video capture apparatus to receive therefrom and process captured digital images/videos to compute atmospheric precipitation rates of atmospheric precipitations which are taking place in the environments shown in the received digital images/videos; and an electronic display device connected to the electronic digital image processing apparatus to receive therefrom and display the computed atmospheric precipitation rate.
    Type: Grant
    Filed: August 10, 2018
    Date of Patent: September 7, 2021
    Assignee: WATERVIEW SRL
    Inventors: Paola Allamano, Andrea Cagninei
  • Patent number: 11109841
    Abstract: A system and method for simultaneously presenting Doppler signals of a Multi-Gated Doppler (MGD) signal corresponding to different anatomical structures is provided. The method includes receiving an MGD signal having a plurality of Doppler signals. The method includes analyzing the MGD signal to select multiple gates, each of the gates corresponding with a Doppler signal, and each of the selected gates associated with a different anatomical structure. The method includes selecting a set of parameters for each of the selected gates and applying each selected set of parameters for each of the selected gates. The selected set of parameters for each of the selected gates may be one or both of image acquisition parameters or display processing parameters. The method includes simultaneously presenting the Doppler signal for each of the selected gates at a display system after the each selected set of parameters is applied.
    Type: Grant
    Filed: December 6, 2018
    Date of Patent: September 7, 2021
    Assignee: GENERAL ELECTRIC COMPANY
    Inventors: Alexander Sokulin, Menachem Halmann, Cynthia A. Owen, Dani Pinkovich
  • Patent number: 11100614
    Abstract: An image processing device includes a transfer function input unit to which each of transfer functions of a plurality of imaging systems is input, a calculation unit that calculates a target resolution value which is a target value of recovery processing that recovers a plurality of captured images to be output from each of the plurality of the imaging systems based on the input transfer functions and a predetermined criterion, a recovery-filter generation unit that generates a recovery-filter used for the recovery processing with respect to each of the plurality of imaging systems based on the transfer functions of the plurality of imaging systems and a target resolution value, and a recovered image generation unit that performs the recovery processing with respect to the captured images acquired from the plurality of imaging systems by using the recovery-filter generated for each of the plurality of imaging systems to generate recovered images.
    Type: Grant
    Filed: July 23, 2019
    Date of Patent: August 24, 2021
    Assignee: FUJIFILM Corporation
    Inventors: Yosuke Naruse, Yasunobu Kishine, Kenkichi Hayashi, Yoshiaki Ishii
  • Patent number: 11100345
    Abstract: A vehicle control system includes: a recognizer that is configured to recognize a surroundings status of a vehicle; and a driving controller that is configured to control at least steering of the vehicle on the basis of the surroundings status recognized by the recognizer, wherein the driving controller is configured to cause the vehicle to run on the basis of a first reference line deviating to one side of a road in a case in which a target obstacle is not recognized in an advancement direction of the vehicle by the recognizer and, is configured to cause the vehicle to avoid the target obstacle after causing the vehicle to run on the basis of a second reference line disposed on an other side of the road from the first reference line, in a case in which the target obstacle is recognized by the recognizer.
    Type: Grant
    Filed: January 31, 2019
    Date of Patent: August 24, 2021
    Assignee: HONDA MOTOR CO., LTD.
    Inventors: Masamitsu Tsuchiya, Hideki Matsunaga, Yasuharu Hashimoto, Etsuo Watanabe, Yuki Oshitani, Ryoma Taguchi
  • Patent number: 11087174
    Abstract: A method is provided for visual inspection. The method includes learning, by a processor, group disentangled visual feature embedding vectors of input images. The input images include defective objects and defect-free objects. The method further includes generating, by the processor using a weight generation network, classification weights from visual features and semantic descriptions. Both the visual features and the semantic descriptions are for predicting defective and defect-free labels. The method also includes calculating, by the processor, a cosine similarity score between the classification weights and the group disentangled visual feature embedding vectors. The method additionally includes episodically training, by the processor, the weight generation network on the input images to update parameters of the weight generation network.
    Type: Grant
    Filed: September 24, 2019
    Date of Patent: August 10, 2021
    Inventors: Renqiang Min, Kai Li, Bing Bai, Hans Peter Graf
  • Patent number: 11087165
    Abstract: Systems and methods for contextualizing automatic image segmentation and/or regression including defining an hourglass neural network model, which includes defining an encoder configured to generate compression layers, including a bottleneck layer, and defining a decoder including a contextual convolution operation and configured to generate one or more reconstruction layers. The contextual convolution operation includes establishing, for each of the one or more reconstruction layers, a skip connection between the reconstruction layer and prior layer(s) of different spatial dimension, e.g., between the bottleneck layer and the reconstruction layer and/or between reconstruction layers.
    Type: Grant
    Filed: July 18, 2019
    Date of Patent: August 10, 2021
    Assignee: NEC CORPORATION
    Inventors: Daniel Onoro-Rubio, Mathias Niepert
  • Patent number: 11087161
    Abstract: A computing system determines accuracy of sport-related information extracted from a time sequence of digital video frames that represent a sport event, the extracted sport-related information including an attribute that changes over the time sequence. The computing system (a) detects, based on the extracted sport-related information, a pattern of change of the attribute over the time sequence and (b) makes a determination of whether the detected pattern is an expected pattern of change associated with the sport event. If the determination is that the detected pattern is the expected pattern, then, responsive to making the determination, the computing system takes a first action that corresponds to the sport-related information being accurate. Whereas, if the determination is that the detected pattern is not the expected pattern, then, responsive to making the determination, the computing system takes a second action that corresponds to the sport-related information being inaccurate.
    Type: Grant
    Filed: January 25, 2019
    Date of Patent: August 10, 2021
    Assignee: Gracenote, Inc.
    Inventors: Jeffrey Scott, Markus Kurt Peter Cremer, Nishit Umesh Parekh, Dewey Ho Lee
  • Patent number: 11087184
    Abstract: A computer-implemented method and system are provided for training a model for New Class Categorization (NCC) of a test image. The method includes decoupling, by a hardware processor, a feature extraction part from a classifier part of a deep classification model by reparametrizing learnable weight variables of the classifier part as a combination of learnable variables of the feature extraction part and of a classification weight generator of the classifier part. The method further includes training, by the hardware processor, the deep classification model to obtain a trained deep classification model by (i) learning the feature extraction part as a multiclass classification task, and (ii) episodically training the classifier part by learning a classification weight generator which outputs classification weights given a training image.
    Type: Grant
    Filed: September 24, 2019
    Date of Patent: August 10, 2021
    Inventors: Renqiang Min, Kai Li, Bing Bai, Hans Peter Graf
  • Patent number: 11074464
    Abstract: A computer includes a processor and a memory storing instructions executable by the processor to receive data from a sensor specifying a plurality of points, the points including a plurality of first points that describe an object; define a boundary surrounding the first points while minimizing a volume of space that is both (i) contained by the boundary and (ii) identified as unoccupied; and actuate a component with respect to a vehicle based on the boundary.
    Type: Grant
    Filed: July 25, 2019
    Date of Patent: July 27, 2021
    Assignee: Ford Global Technologies, LLC
    Inventors: Sangjin Lee, Krishanth Krishnan, Ankit Girish Vora, Siddharth Agarwal
  • Patent number: 11074430
    Abstract: Methods and systems are provided for providing directional assistance to guide a user to position a camera for centering a person's face within the camera's field of view. A neural network system is trained to determine the position of the user's face relative to the center of the field of view as captured by an input image. The neural network system is trained using training input images that are generated by cropping different regions of initial training images. Each initial image is used to create a plurality of different training input images, and directional assistance labels used to train the network may be assigned to each training input image based on how the image is cropped. Once trained, the neural network system determines a position of the user's face, and automatically provides a non-visual prompt indicating how to center the face within the field of view.
    Type: Grant
    Filed: May 29, 2018
    Date of Patent: July 27, 2021
    Assignee: ADOBE INC.
    Inventors: Sachin Soni, Siddharth Kumar, Ram Bhushan Agrawal, Ajay Jain
  • Patent number: 11059493
    Abstract: Systems and methods for estimating velocity of an autonomous vehicle and state information of a surrounding vehicle are provided. In some aspects, the system includes a memory that stores instructions for executing processes for estimating velocity of an autonomous vehicle and state information of the surrounding vehicle and a processor configured to execute the instructions. In various aspects, the processes include: receiving image data from an image capturing device; performing a ground plane estimation by predicting a depth of points on a road surface based on an estimated pixel-level depth; determining a three-dimensional (3D) bounding box of the surrounding vehicle; determining the state information of the surrounding vehicle based on the ground plane estimation and the 3D bounding box; and determining the velocity of the autonomous vehicle based on an immovable object relative to the autonomous vehicle.
    Type: Grant
    Filed: April 10, 2019
    Date of Patent: July 13, 2021
    Assignee: HONDA MOTOR CO., LTD.
    Inventors: Jun Hayakawa, Behzad Dariush
  • Patent number: 11055560
    Abstract: The disclosed technology is generally directed to optical text recognition for forms. In one example of the technology, line grouping rules are generated based on the generic forms and a ground truth for the generic forms. Line groupings are applied to the generic forms based on the line grouping rules. Feature extraction rules are generated. Features are extracted from the generic forms based on the feature extraction rules. A key-value classifier model is generated, such that the key-value classifier model is configured to determine, for each line of a form: a probability that the line is a value, and a probability that the line is a key. A key-value pairing model is generated, such that the key-value pairing model is configured to predict, for each key in a form, which value in the form corresponds to the key.
    Type: Grant
    Filed: May 15, 2019
    Date of Patent: July 6, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Dinei Afonso Ferreira Florencio, Cha Zhang, Gil Moshe Nahmias, Yu-Yun Dai, Sean Louis Goldberg
  • Patent number: 11043004
    Abstract: An illustrative, non-limiting method for resolving Region-On-Interest (ROI) overlaps includes receiving Simultaneous Localization and Mapping (SLAM) data obtained by a plurality of co-located Head-Mounted Devices (HMD), where the SLAM data comprises a plurality of landmarks and each HMD has an Information Handling System (IHS) in communication therewith. Each IHS may produce a subset of the plurality of landmarks based upon a respective HMD's SLAM data, and each IHS is: local with respect to the plurality of HMDs, at an edge of a network serving an HMD, or on a cloud. The method may include identifying an overlap between a first landmark produced by a first IHS and a second landmark produced by a second IHS, selecting between the first and second landmarks, at least in part, based upon the locations of the first and second IHSs, and rendering a map for display by a given HMD using the selected landmark.
    Type: Grant
    Filed: May 22, 2019
    Date of Patent: June 22, 2021
    Assignee: Dell Products, L.P.
    Inventors: Vivek Viswanathan Iyer, Michael S. Gatson
  • Patent number: 11042982
    Abstract: An ultra-dense electrode-based brain imaging system with high spatial and temporal resolution. A Sparsity and Smoothness enhanced Method Of Optimized electrical TomograpHy (s-SMOOTH) based reconstruction technique to improve the spatial resolution and localization accuracy of reconstructed brain images is described. Also described is a graph Fractional-Order Total Variation (gFOTV) based reconstruction technique to improve the spatial resolution and localization accuracy of reconstructed brain images.
    Type: Grant
    Filed: March 5, 2018
    Date of Patent: June 22, 2021
    Assignee: THE REGENTS OF THE UNIVERSITY OF CALIFORNIA
    Inventors: Wentai Liu, Ying Li, Jing Qin, Chi-Wei Chang, Yi-Kai Lo