Patents Examined by David F Dunphy
  • Patent number: 11151416
    Abstract: Artificial intelligence is an increasingly important sector of the computer industry. One of the most important applications for artificial intelligence is object recognition and classification from digital images. Convolutional neural networks have proven to be a very effective tool for object recognition and classification from digital images. However, convolutional neural networks are extremely computationally intensive thus requiring high-performance processors, significant computation time, and significant energy consumption. To reduce the computation time and energy consumption a “cone of dependency” and “cone of influence” processing techniques are disclosed. These two techniques arrange the computations required in a manner that minimizes memory accesses such that computations may be performed in local cache memory. These techniques significantly reduce the time to perform the computations and the energy consumed by the hardware implementing a convolutional neural network.
    Type: Grant
    Filed: September 11, 2019
    Date of Patent: October 19, 2021
    Assignee: Expedera, Inc.
    Inventors: Shang-Tse Chuang, Sharad Vasantrao Chole, Siyad Chih-Hua Ma
  • Patent number: 11151371
    Abstract: A method for splitting text line images includes receiving a text line image and identifying that the text line image comprises a plurality of zones, wherein each zone includes text whose font differs from the text of adjacent zones. The method further includes selecting a splitting position between multiple zones and splitting the text line image at the splitting position into a plurality of image segments, wherein each image segment contains at least one zone of the text line image and performing optical character recognition on each image segment to recognize a text segment of the image segment. In certain implementations, the method further includes generating one or more confidence measurements and selecting a splitting position that corresponds to a large gradient in the confidence measurement.
    Type: Grant
    Filed: August 21, 2019
    Date of Patent: October 19, 2021
    Assignee: LEVERTON HOLDING, LLC
    Inventors: Florian Kuhlmann, Michael Kieweg
  • Patent number: 11151401
    Abstract: A method for consistently mounting a removable sensor to a machine is provided. The method includes recording, by camera, an image including a sensor placed on a target. The sensor includes a first plane marked with a first color that is perpendicular to a first sensor axis representing a positive axis direction. The method also includes determining, by accelerometer, an image orientation concurrently with the recording. The method further includes identifying the sensor within the image. The method additionally includes determining, using the identified first color, a sensor orientation within the image relative to the image orientation. The sensor orientation includes the positive axis direction. The method also includes comparing the sensor orientation to a reference orientation. The method further includes determining the sensor orientation matches the reference orientation and recording a target measurement in response.
    Type: Grant
    Filed: October 31, 2019
    Date of Patent: October 19, 2021
    Assignee: Baker Hughes Oilfield Operations LLC
    Inventor: Aaron R. Hampton
  • Patent number: 11151365
    Abstract: A people detection system with feature space enhancement is provided. The system includes a memory having computer-readable instructions stored therein. The system includes a processor configured to access a plurality of video frames captured using one or more overhead video cameras installed in a space and to extract one or more raw images of the space from the plurality of video frames. The processor is further configured to process the one or more raw images to generate a plurality of positive image samples and a plurality of negative image samples. The positive image samples include images having one or more persons present within the space and the negative image samples comprise images without the persons.
    Type: Grant
    Filed: June 10, 2019
    Date of Patent: October 19, 2021
    Assignee: Capillary Technologies International PTE LTD
    Inventors: Sumandeep Banerjee, Subrat Panda, Doney Alex
  • Patent number: 11151422
    Abstract: Empty container identification method and system are disclosed. The method includes: obtaining customs declaration information, and finding out an vehicle declared as an empty container or an empty vehicle from the customs declaration information; performing X-ray inspection on the vehicle to acquire a transmission image of the vehicle; inputting the transmission image into an empty container identification model obtained by pre-training, so that the empty container identification model determines candidate regions of the transmission image, and performs post-processing analysis on the candidate regions to obtain an image identification result; and comparing the image identification result with the corresponding customs declaration information to determine whether or not the image identification result is consistent with the customs declaration information.
    Type: Grant
    Filed: December 23, 2019
    Date of Patent: October 19, 2021
    Assignees: NUCTECH COMPANY LIMITED, Tsinghua University
    Inventors: Yanjie Yao, Yongchun Liu, Yan Zhang, Ziran Zhao, Li Zhang, Yuxiang Xing
  • Patent number: 11144784
    Abstract: Text-to-visual machine learning embedding techniques are described that overcome the challenges of conventional techniques in a variety of ways. These techniques include use of query-based training data which may expand availability and types of training data usable to train a model. Generation of negative digital image samples is also described that may increase accuracy in training the model using machine learning. A loss function is also described that also supports increased accuracy and computational efficiency by losses separately, e.g., between positive or negative sample embeddings a text embedding.
    Type: Grant
    Filed: May 30, 2019
    Date of Patent: October 12, 2021
    Assignee: Adobe Inc.
    Inventors: Pranav Vineet Aggarwal, Zhe Lin, Baldo Antonio Faieta, Saeid Motiian
  • Patent number: 11138451
    Abstract: A training image selection system 1, 1? comprises: an imaging device 21, 22 capturing an outside of a host vehicle to generate images, a storage device 32 storing the images generated by the imaging device, a detecting part 34 configured to detect operation of signaling lights of the host vehicle, and an image selecting part 35 configured to select training images from the images generated by the imaging device. If the detecting part detects operation of signaling lights, the image selecting part is configured to select images generated at timings within a predetermined range from when operation of signaling lights is detected, as training images.
    Type: Grant
    Filed: September 16, 2019
    Date of Patent: October 5, 2021
    Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHA
    Inventors: Satoshi Takeyasu, Daisuke Hashimoto, Kota Hirano
  • Patent number: 11138476
    Abstract: A method includes identifying images associated with a user, where the image is identified as at least one of captured by a user device associated with the user, stored on the user device associated with the user, and stored in cloud storage associated with the user. The method also includes for each of the images, determining one or more labels, wherein the one or more labels are based on at least one of metadata and a primary annotation. The method also includes generating a mapping of the one or more labels to one or more confidence scores, wherein the one or more confidence scores indicate an extent to which the one or more labels apply to corresponding images. The method also includes interacting with the user to obtain identifying information that is used to categorize one or more of the images.
    Type: Grant
    Filed: March 28, 2019
    Date of Patent: October 5, 2021
    Assignee: Google LLC
    Inventors: Robin Dua, Sujith Ravi
  • Patent number: 11132539
    Abstract: A posture recognition system includes a sensor and a recognition apparatus, wherein the sensor captures a distance image including information on a distance to a subject, at an angular field controlled based on the distance to the subject, and the recognition apparatus includes a memory, and a processor coupled to the memory and configured to acquire the distance image and the angular field used when the sensor captures the distance image, from the sensor, and correct the acquired distance image based on a ratio between a first resolution corresponding to another angular field used when a training distance image is captured, and a second resolution corresponding to the acquired angular field, the training distance image being used for generating a learning model which recognizes a posture of the subject.
    Type: Grant
    Filed: March 6, 2020
    Date of Patent: September 28, 2021
    Assignee: FUJITSU LIMITED
    Inventors: Yoshihisa Asayama, Shoichi Masui
  • Patent number: 11126196
    Abstract: The described positional awareness techniques employing sensory data gathering and analysis hardware with reference to specific example implementations implement improvements in the use of sensors, techniques and hardware design that can enable specific embodiments to provide positional awareness to machines with improved speed and accuracy. The sensory data are gathered from an operational camera and one or more auxiliary sensors.
    Type: Grant
    Filed: October 9, 2019
    Date of Patent: September 21, 2021
    Assignee: Trifo, Inc.
    Inventors: Zhe Zhang, Grace Tsai, Shaoshan Liu
  • Patent number: 11113784
    Abstract: Embodiments described herein include, software, firmware, and hardware logic that provides techniques to perform arithmetic on sparse data via a systolic processing unit. Embodiment described herein provided techniques to skip computational operations for zero filled matrices and sub-matrices. Embodiments additionally provide techniques to maintain data compression through to a processing unit. Embodiments additionally provide an architecture for a sparse aware logic unit.
    Type: Grant
    Filed: October 6, 2020
    Date of Patent: September 7, 2021
    Assignee: Intel Corporation
    Inventors: Joydeep Ray, Scott Janus, Varghese George, Subramaniam Maiyuran, Altug Koker, Abhishek Appu, Prasoonkumar Surti, Vasanth Ranganathan, Andrei Valentin, Ashutosh Garg, Yoav Harel, Arthur Hunter, Jr., SungYe Kim, Mike Macpherson, Elmoustapha Ould-Ahmed-Vall, William Sadler, Lakshminarayanan Striramassarma, Vikranth Vemulapalli
  • Patent number: 11113825
    Abstract: A projected image item tracking system that analyzes projected camera images to determine items taken from, placed on, or moved on a shelf or other area in an autonomous store. The items and actions performed on them may then be attributed to a shopper near the area. Projected images may be combined to generate a 3D volume difference between the state of the area before and after shopper interaction. The volume difference may be calculated using plane-sweep stereo, or using convolutional neural networks. Because these methods may be computationally intensive, the system may first localize a change volume where items appear to have been displaced, and then generate a volume difference only within that change volume. This optimization results in significant savings in power consumption and in more rapid identification of items. The 3D volume difference may also indicate the quantity of items displaced, for example from a vertical stack.
    Type: Grant
    Filed: September 6, 2019
    Date of Patent: September 7, 2021
    Assignee: ACCEL ROBOTICS CORPORATION
    Inventors: Marius Buibas, John Quinn, Kaylee Feigum, Csaba Petre, Michael Brandon Maseda, Martin Alan Cseh
  • Patent number: 11106939
    Abstract: A processing method for high-order tensor data, which can avoid that the vectorization process of the image observation sample set damage the internal structure of the data, simplify the large amount of redundant information in the high-order tensor data in the image observation sample set, and improve the image processing speed. In this processing method for high-order tensor data, the high-order tensor data are divided into three parts: the shared subspace component, the personality subspace component and the noise part; the shared subspace component and the personality subspace component respectively represent the high-order tensor data as a group of linear combination of the tensor base and the vector coefficient; the variational EM method is used to solve the base tensor and the vector coefficient; design a classifier to classify the test samples by comparing the edge distribution of samples.
    Type: Grant
    Filed: December 11, 2019
    Date of Patent: August 31, 2021
    Assignee: BEIJING UNIVERSITY OF TECHNOLOGY
    Inventors: Yanfeng Sun, Fujiao Ju
  • Patent number: 11106941
    Abstract: A system having a bar containing distance sensors, such as LIDARs, that may be installed behind a shelf in an automated store. Shelves may be divided into storage zones, such as bins or lanes, and a distance sensor may measure the item quantity in each zone. Quantity changes indicate that a shopper has taken or placed items in the zone. Quantity changes may trigger analysis of camera images of the shelf to identify the items taken or replaced. The distance sensor elements within the bar may be relocatable so they can be positioned correctly behind the corresponding storage zones. The bar may have mounting mechanisms on either side for attachment to shelving support structures. These mounting mechanisms may include security locks. The bar may rotate relative to the mounting mechanisms to provide access to the shelf from behind.
    Type: Grant
    Filed: March 4, 2020
    Date of Patent: August 31, 2021
    Assignee: ACCEL ROBOTICS CORPORATION
    Inventors: Marius Buibas, Aleksander Bapst, Filip Piekniewski, Mark Graham, Yohei Yamamuro, Jose Miguel Rodriguez
  • Patent number: 11106951
    Abstract: A bidirectional image-text retrieval method based on a multi-view joint embedding space includes: performing retrieval with reference to a semantic association relationship at a global level and a local level, obtaining the semantic association relationship at the global level and the local level in a frame-sentence view and a region-phrase view, and obtaining semantic association information in a global level subspace of frame and sentence in the frame-sentence view, obtaining semantic association information in a local level subspace of region and phrase in the region-phrase view, processing data by a dual-branch neural network in the two views to obtain an isomorphic feature and embedding the same in a common space, and using a constraint condition to reserve an original semantic relationship of the data during training, and merging the two semantic association relationships using multi-view merging and sorting to obtain a more accurate semantic similarity between data.
    Type: Grant
    Filed: January 29, 2018
    Date of Patent: August 31, 2021
    Assignee: Peking University Shenzhen Graduate Sohool
    Inventors: Wenmin Wang, Lu Ran, Ronggang Wang, Ge Li, Shengfu Dong, Zhenyu Wang, Ying Li, Hui Zhao, Wen Gao
  • Patent number: 11100648
    Abstract: System and techniques for detecting a crop related row from an image are described herein. An image that includes several rows where the several rows including crop rows and furrows can be obtained. The image can be segmented to produce a set of image segments. A filter can be shifted across respective segments of the set of image segments to get a set of positions. A line can be fit members of the set of positions, the line representing a crop row or furrow.
    Type: Grant
    Filed: July 11, 2019
    Date of Patent: August 24, 2021
    Assignee: Raven Industries, Inc.
    Inventors: Yuri Sneyders, John D. Preheim, Jeffrey Allen Van Roekel
  • Patent number: 11093755
    Abstract: A system, method, and computer program product for segmenting videos. The system includes at least one processing component, at least one memory component, a video, an extraction component, and a graphing component. The extraction component is configured to extract image and text data from the video, identify entities in the image data, assign at least one entity relation to the entities in the image data, identifying entities in the text data, and assign at least one entity relation to the entities in the text data. The graphing component is configured to generate an image knowledge graph for the entity relations assigned to the entities in the image data, generate a text knowledge graph for the entity relations assigned to the at least two entities in the text data, and generate a weighted knowledge graph based on the image and text knowledge graphs.
    Type: Grant
    Filed: November 19, 2019
    Date of Patent: August 17, 2021
    Assignee: International Business Machines Corporation
    Inventors: Wan Wan Miao, Kun Yan Yin, Jian Gong Wang, Yan Hu, Lian Na Wang
  • Patent number: 11087454
    Abstract: A defect observation device comprising: a defect determination coordinate creation unit by which the coordinates of a plurality of second defect candidates are determined as overlapping defect candidate coordinates, the plurality of second defect candidates respectively having, in a plurality of second imaging visual field regions overlapping a first imaging visual field region, a circuit pattern which partly overlaps a circuit pattern in the first imaging visual field region, in which a first defect candidate for defect determination among a plurality of defect candidates of a sample is present; a pseudo-reference image generation unit which generates a pseudo-reference image including a circuit pattern of the first defect candidate by superimposing a plurality of images respectively captured at the plurality of overlapping defect candidate coordinates; and a defect determination unit which compares an image for defect determination captured at the coordinates of the first defect candidate with the pseudo-re
    Type: Grant
    Filed: March 17, 2017
    Date of Patent: August 10, 2021
    Assignee: HITACHI HIGH-TECH CORPORATION
    Inventors: Naoaki Kondo, Minoru Harada, Yuji Takagi, Takehiro Hirai
  • Patent number: 11080236
    Abstract: A novel high-throughput embedding generation and comparison system for executable code is presented in this invention. More specifically, the invention relates to a deep-neural-network based graph embedding generation and comparison system. A novel bi-directional code graph embedding generation has been proposed to enrich the information extracted from code graph. Furthermore, by deploying matrix manipulation, the throughput of the system has significantly increased for embedding generation. Potential applications such as executable file similarity calculation, vulnerability search are also presented in this invention.
    Type: Grant
    Filed: March 11, 2021
    Date of Patent: August 3, 2021
    Assignees: DEEPBITS TECHNOLOGY INC., THE REGENTS OF THE UNIVERSITY OF CALIFORNIA
    Inventors: Heng Yin, Xunchao Hu, Sheng Yu, Yu Zheng
  • Patent number: 11074680
    Abstract: An object identification and collection method is disclosed. The method includes receiving a pick-up path that identifies a route in which to guide an object-collection system over a target geographical area to pick up objects, determining a current location of the object-collection system relative to the pick-up path, and guiding the object-collection system along the pick-up path over the target geographical area based on the current location. The method further includes capturing images in a direction of movement of the object-collection system along the pick-up path, identifying a target object in the images; tracking movement of the target object through the images, determining that the target object is within range of an object picker assembly on the object-collection system based on the tracked movement of the target object, and instructing the object picker assembly to pick up the target object.
    Type: Grant
    Filed: July 12, 2019
    Date of Patent: July 27, 2021
    Assignee: TERRACLEAR INC.
    Inventors: Brent Ronald Frei, Dwight Galen McMaster, Michael Racine, Jacobus du Preez, William David Dimmit, Isabelle Butterfield, Clifford Holmgren, Dafydd Daniel Rhys-Jones, Thayne Kollmorgen, Vivek Ullal Nayak