Patents Examined by Ming Y Hon
  • Patent number: 11514667
    Abstract: A method and an apparatus for camera-free light field video processing with all-optical neural network are disclosed. The method includes: mapping the light field video by a digital micro-mirror device (DMD) and an optical fiber coupler, a two-dimensional 2D spatial optical signal into a one-dimensional 1D input optical signal; realizing a multiply-accumulate computing model in a structure of all-optical recurrent neural network structure, and processing the 1D input signal to obtain the processed signal; and receiving the processed signal and outputting an electronic signal by a photodetector, or receiving the processed signal by a relay optical fiber for relay transmission of the processed signal. The method and system here realize light field video processing without the use of a camera and the whole system is all-optical, thus possessing the advantage in computing speed and energy-efficiency.
    Type: Grant
    Filed: March 25, 2022
    Date of Patent: November 29, 2022
    Assignee: TSINGHUA UNIVERSITY
    Inventors: Lu Fang, Tiankuang Zhou, Siyuan Gu, Xiaoyun Yuan, Qionghai Dai
  • Patent number: 11508057
    Abstract: An inspection system for a vehicle underbody in an in-line process includes: a vehicle recognition unit for acquiring a vehicle ID by recognizing a vehicle entering an inspection process; a vision system that photographs the vehicle underbody through a plurality of cameras disposed under a vehicle moving direction (Y-axis) and disposed at vertical and diagonal angles along a width direction (X-axis) of the vehicle; and an inspection server that detects assembly defects of a component by performing at least one of a first vision inspection that matches an object image for each component through a rule-based algorithm or a secondary deep-learning inspection through a deep-learning engine by acquiring a vehicle underbody image photographed by operating the vision system with setting information suitable for a vehicle type and a specification according to the vehicle ID.
    Type: Grant
    Filed: December 1, 2020
    Date of Patent: November 22, 2022
    Assignees: Hyundai Motor Company, Kia Motors Corporation
    Inventor: Kang Wook Lee
  • Patent number: 11501511
    Abstract: The present invention relates to a robust method for optical recognition of markers in an outdoor environment. In this context, the present invention provides a method for optical recognition of optical markers comprising the steps of: acquiring an image; identifying regions of contiguous colours in the image by flood filling; extracting data and parameters of the contiguous regions; and detecting an optical marker by means of a convex hull algorithm and prediction of position of squares based on the data and parameters extracted from the contiguous Thus, the method of the present invention allows identification of markers, such as chequerboards and targets, unequivocally and with enough robustness as regards partial occlusions and variations of illumination.
    Type: Grant
    Filed: February 19, 2019
    Date of Patent: November 15, 2022
    Assignee: Petróleo Brasileiro S.A.—Petrobras
    Inventor: Douglas Coimbra De Andrade
  • Patent number: 11495035
    Abstract: Provided is a notification management method of a mobile terminal including generating a screenshot image, determining a category of the screenshot image based on a text or an image included in the screenshot image, and extracting a text or an image related to the category and generating notification information using the extracted text or image. The user equipment and the AI system of this disclosure may be associated with artificial intelligence modules, drones (unmanned aerial vehicles (UAVs)), robots, augmented reality (AR) devices, virtual reality (VR) devices, and devices related to 5G services.
    Type: Grant
    Filed: September 11, 2020
    Date of Patent: November 8, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Hyunjin Hwang, Changhee Han, Kyudae Bahn, Sanghoon Lee
  • Patent number: 11490102
    Abstract: An image processing method includes selecting an image in fixed storage of a computer and loading the selected image into memory of the computer. The method further includes representing the loaded image by a processor of the computer in the memory as an initial two-dimensional array of pixel values. Thereafter, the initial two-dimensional array of pixel values may be transformed into a hierarchy of progressively axially decremented two-dimensional arrays of signs and a pair of one-dimensional values for each 2×2 array of signs amongst the decremented two-dimensional arrays of signs. Finally, each of the two-dimensional arrays of signs and each pair of one-dimensional values may be stored in the fixed storage as a compressed form of the selected image.
    Type: Grant
    Filed: June 30, 2020
    Date of Patent: November 1, 2022
    Assignee: Awecom, Inc.
    Inventors: Christopher J. Hillar, Ram Mehta, Kilian Koepsell, Charles Garfinkle
  • Patent number: 11488377
    Abstract: Provided are methods for customized tags for annotating sensor data, which can include receiving sensor data captured during a plurality of sensor data capture sessions, processing the sensor data using a plurality of machine learning models to identify a plurality of capture session collections represented in the sensor data, filtering the sensor data based at least partly on a user-specified category of the plurality of categories of capture session to identify a capture session collection, of the plurality of capture session collections, representing sensor data of one or more sensor data capture sessions that conforms to the user-specified category, and transmitting the sensor data of one or more sensor data capture sessions that conforms to the user-specified category to an end user computing device. Systems and computer program products are also provided.
    Type: Grant
    Filed: March 23, 2022
    Date of Patent: November 1, 2022
    Assignee: Motional AD LLC
    Inventors: Qiang Xu, Oscar Beijbom, Holger Caesar, Whye Kit Fong, Alex Lang, Varun Bankiti, Sourabh Vora
  • Patent number: 11481990
    Abstract: An information processing device is an information processing device including a processor. The processor obtains a detection result of a first detector for detecting a first target in first sensing data; and based on the detection result of the first detector, determines a setting of processing by a second detector for detecting a second target in second sensing data next in an order after the first sensing data, the second target being different from the first target.
    Type: Grant
    Filed: January 14, 2021
    Date of Patent: October 25, 2022
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Yasunori Ishii, Takuya Yamaguchi, Yohei Nakata, Ryota Fujimura, Sotaro Tsukizawa
  • Patent number: 11443602
    Abstract: A prohibited object detection system detects improper use of an object in an area being monitored. An image of an object detected in an area associated with a monitored individual, such as a patient room, is collected, and the system identifies reference points on the object. The system may compare the reference points to reference points of known improper uses of the object. The system may determine whether the detected object in the improper use position is in proximity to at least a portion of the monitored individual or other person within the monitored area. One or more designated recipients may be alerted if the object is in a position consistent with an improper use.
    Type: Grant
    Filed: January 19, 2021
    Date of Patent: September 13, 2022
    Assignee: CERNER INNOVATION, INC.
    Inventors: Michael Kusens, Neil Kusens
  • Patent number: 11442670
    Abstract: Systems and methods for bypassing a print dialog box that indicates a print confirmation, a prompt message, or a page preview, by employing a background print applet. The systems and methods may include detecting a print content to be printed by a printer, identifying one or more features of the print content, and determining one or more print settings based on the identified one or more features. The systems and methods may further include initiating the print content to be printed by the printer based on the determined print settings, whereby initiating the print content includes bypassing the print dialog box.
    Type: Grant
    Filed: February 21, 2020
    Date of Patent: September 13, 2022
    Assignee: The Western Union Company
    Inventors: Anthony Scillieri, Venkateshwarlu Kotagiri, Denis McCarthy
  • Patent number: 11443532
    Abstract: An information processing apparatus comprising a situation acquiring unit configured to acquire a situation of one movable object, and a storing execution unit configured to store a face image of an occupant on the one movable object, captured by an image-capturing unit mounted on the one movable object when the one movable object is in a predetermined situation, as a face image of the occupant with neutral facial expression is provided.
    Type: Grant
    Filed: December 22, 2019
    Date of Patent: September 13, 2022
    Assignee: HONDA MOTOR CO., LTD.
    Inventors: Yoshikazu Matsuo, Hisumi Esaki, Takashi Okada, Hiromi Sato
  • Patent number: 11436440
    Abstract: Provided is a method of DNN-based image processing by an imaging device. The method comprises obtaining, by the imaging device, at least one input image with a plurality of color channels, simultaneously extracting, by the imaging device, a semantic information from each of the color channels of the at least one input image and a color correlation information from each of the color channels of the at least one input image, and generating, by the imaging device, at least one output image based on the extracted semantic information and the extracted color correlation information.
    Type: Grant
    Filed: May 28, 2019
    Date of Patent: September 6, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Tej Pratap Gvsl, Vishal Keshav
  • Patent number: 11419701
    Abstract: Apparatuses and methods for performing orthodontic treatment planning are provided. Virtual/Augmented Reality devices can be used to virtually manipulate patient's teeth, modify virtual models of the patient's teeth, analyze the fit of a dental appliance on the patient's teeth, analyze the position of attachment sites for dental appliances, and provide overlays showing forces applied to the patient's teeth. The VR/AR devices can be used by physicians and/or the patient to provide and display treatment planning.
    Type: Grant
    Filed: March 1, 2021
    Date of Patent: August 23, 2022
    Assignee: Align Technology, Inc.
    Inventors: Yaser Shanjani, Bruce Cam
  • Patent number: 11423669
    Abstract: An emotion prediction device mounted on a vehicle includes a control unit. The control unit is capable of executing functions of a first prediction unit configured to predict an emotion of a user based on a facial expression of the user, a second prediction unit configured to predict an emotion of the user based on the motion of the user, and a third prediction unit configured to predict the emotion of the user based on the emotion predicted by the first prediction unit and the emotion predicted by the second prediction unit. The control unit is capable of restricting execution of at least a part of the functions of the first, second, and third prediction units, based on at least a processing load of the control unit.
    Type: Grant
    Filed: November 27, 2020
    Date of Patent: August 23, 2022
    Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHA
    Inventors: Midori Ichikawa, Toshiya Satake, Yasunao Yoshizaki
  • Patent number: 11403835
    Abstract: A method and a device for processing feature points of an image are provided. A specific embodiment of the method includes obtaining an image to be processed; determining weights of the feature points of the image to be processed to obtain a weight set; and according to the weights, selecting target numbered feature points as target feature points of the image to be processed. The weights include a texture weight; the texture weight and a color change scope of pixels in a target sized image region in which the feature points locate are directly proportional. The embodiment can reduce the number of feature points of the image, and further release the storage pressure of feature points regarding the image.
    Type: Grant
    Filed: December 10, 2018
    Date of Patent: August 2, 2022
    Assignee: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
    Inventors: Cheng Yang, Yi He, Lei Li
  • Patent number: 11398094
    Abstract: Motion of actors within a scene may be detected based on imaging data, using machine learning tools operating on cameras that captured the imaging data. The machine learning tools process images to perform a number of tasks, including detecting heads of actors, and sets of pixels corresponding to the actors, before constructing line segments from the heads of the actors to floor surfaces on which the actors stand or walk. The line segments are aligned along lines extending from locations of heads within an image to a vanishing point of a camera that captured the image. Trajectories of actors and visual data are transferred from the cameras to a central server, which links trajectories captured by multiple cameras and locates detected actors throughout the scene, even when the actors are not detected within a field of view of at least one camera.
    Type: Grant
    Filed: April 6, 2020
    Date of Patent: July 26, 2022
    Assignee: Amazon Technologies, Inc.
    Inventors: Samuel Nathan Hallman, Tian Lan, Hui Liang, Gerard Guy Medioni, Kostia Robert
  • Patent number: 11386650
    Abstract: An approach is provided for detecting and map-coding a tunnel based on probes and image data. The approach involves, for example, identifying a gap in probe data collected from one or more location sensors of a plurality vehicles. The gap represents a probe gap segment along which at least one probe point of the probe data does not occur or occurs below a threshold number. The approach also involves retrieving image data depicting a geographic area based on location coordinate data associated with the gap. The approach further involves processing the image data to identify one or more end points of a road network depicted in the image data. The approach further involves locating a tunnel start point and/or a tunnel end point based on the one or more endpoints. The approach further involves providing the tunnel start point and/or the tunnel end point as a map data output.
    Type: Grant
    Filed: December 8, 2020
    Date of Patent: July 12, 2022
    Assignee: HERE Global B.V.
    Inventor: Ashish Deepchand Yadav
  • Patent number: 11380009
    Abstract: A physique estimation device includes: a camera capturing an image of an inside of a vehicle; a skeleton point coordinate acquisition unit acquiring positions of skeleton points of a body image of an occupant included in a captured image of the inside as skeleton point coordinates in a two-dimensional coordinate system of the captured image; a front coordinate estimation unit machine learned such that, by receiving a distance between preset skeleton points and an angle of a skeleton line obtained by connecting the skeleton points with respect to a reference line, a front coordinate that is an arrangement of the skeleton points when the occupant is viewed from front is estimated and output; and a physique determination unit determining a physique of the occupant based on the front coordinate.
    Type: Grant
    Filed: October 14, 2020
    Date of Patent: July 5, 2022
    Assignee: AISIN CORPORATION
    Inventors: Godai Tanaka, Yoshiaki Tomatsu, Takayuki Nakagome
  • Patent number: 11369999
    Abstract: There is provided a parcel determination device that determines whether or not parcel recognized in a first recognition region provided in a predetermined transport path and parcel recognized in a second recognition region being disposed on a downstream side from the first recognition region in the transport path and being discontinuous with the first recognition region are the same parcel, the device including: a processor; and a memory, in which by cooperating with the memory, the processor determines whether or not parcel which leaves the first recognition region and parcel which enters the second recognition region are the same parcel, based on whether or not a time when parcel leaves the first recognition region and a time when parcel enters the second recognition region correspond to a time required for parcel to be transported between the two recognition regions.
    Type: Grant
    Filed: May 16, 2018
    Date of Patent: June 28, 2022
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Takaaki Idera, Takaaki Moriyama, Shohji Ohtsubo
  • Patent number: 11354890
    Abstract: An information processing apparatus includes a processor configured to acquire image data from preprocessing, calculate information related to accuracy of a result of processing for each partial region of an image corresponding to the acquired image data, and notify the preprocessing of the calculated information related to the accuracy and information for specifying a corresponding partial region.
    Type: Grant
    Filed: July 6, 2020
    Date of Patent: June 7, 2022
    Assignee: FUJIFILM Business Innovation Corp.
    Inventors: Hiroyoshi Uejo, Yuki Yamanaka
  • Patent number: 11348332
    Abstract: A method for controlling a robotic device based on observed object locations is presented. The method includes observing objects in an environment. The method also includes generating a probability distribution for locations of the observed objects. The method further includes controlling the robotic device to perform an action in the environment based on the generated probability distribution.
    Type: Grant
    Filed: September 25, 2019
    Date of Patent: May 31, 2022
    Assignee: TOYOTA RESEARCH INSTITUTE, INC.
    Inventor: Brandon Northcutt