Patents Examined by Owais Iqbal Memon
  • Patent number: 12195032
    Abstract: A method determines the region where a vehicle can travel without changing clarity of the position information of the object detected by a sensor. An in-vehicle control device includes an object detection unit detecting the position of an object from image information captured by an image pickup device, an object information storage unit stores a pre-processing grid map including a position of a detected object set as an object occupied region and a position where no object has been detected is as an object unoccupied region, an information processing unit generates a determination grid map in which part of the object unoccupied region of the map is replaced with the object occupied region, and a road surface region determination unit that generates an automatic driving grid map in which a closed space surrounded by the object occupied region of the determination grid map is set as a road surface region.
    Type: Grant
    Filed: October 23, 2019
    Date of Patent: January 14, 2025
    Assignee: HITACHI ASTEMO, LTD.
    Inventors: Masanori Ichinose, Akira Kuriyama, Haruki Nishimura
  • Patent number: 12198314
    Abstract: An image processing method includes: receiving an input image; performing a low-frequency image regulating operation to regulate the local intensity of the image of pixel unit(s) according to low-frequency information of the image of pixel unit(s) of the input image; performing a high-frequency image regulating operation to improve the details of the image of pixel unit(s) according to high-frequency information of the image of pixel unit (s) of the input image; and, generating an output image according to the input image, the low-frequency image regulating operation, and the high-frequency image regulating operation.
    Type: Grant
    Filed: April 13, 2022
    Date of Patent: January 14, 2025
    Assignee: Realtek Semiconductor Corp.
    Inventors: Yu-Hsuan Kuan, Tsung-Hsuan Li, Shih-Tse Chen
  • Patent number: 12190531
    Abstract: An image processing device according to one embodiment estimates first optical flow information of a pixel unit on the basis of consecutive frames, and estimates a polynomial model corresponding to the optical flow information. The image processing device estimates second optical flow information of holes included in the frames on the basis of the polynomial model, and inpaints an input image on the basis of the first optical flow information and/or the second optical flow information.
    Type: Grant
    Filed: February 21, 2019
    Date of Patent: January 7, 2025
    Assignee: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY
    Inventors: Junyong Noh, Julie Alfonsine E. Lelong, Bumki Kim, Hanui Lee, Gukho Kim, Mohammad Reza Karimi Dastjerdi, Allen Kim, Jiwon Lee
  • Patent number: 12183063
    Abstract: In examples, image data representative of an image of a field of view of at least one sensor may be received. Source areas may be defined that correspond to a region of the image. Areas and/or dimensions of at least some of the source areas may decrease along at least one direction relative to a perspective of the at least one sensor. A downsampled version of the region (e.g., a downsampled image or feature map of a neural network) may be generated from the source areas based at least in part on mapping the source areas to cells of the downsampled version of the region. Resolutions of the region that are captured by the cells may correspond to the areas of the source areas, such that certain portions of the region (e.g., portions at a far distance from the sensor) retain higher resolution than others.
    Type: Grant
    Filed: June 30, 2020
    Date of Patent: December 31, 2024
    Assignee: NVIDIA Corporation
    Inventors: Haiguang Wen, Bernhard Firner, Mariusz Bojarski, Zongyi Yang, Urs Muller
  • Patent number: 12169938
    Abstract: Embodiments of this specification provide methods and apparatuses for processing images, devices, and storage media. A method includes: obtaining an image for processing; generating a first mask image corresponding to the image based on a machine-learning model and determining whether the image has a foreground object; in response to determining that the image has the foreground object, setting pixels corresponding to the foreground object to a first grayscale value range, and setting pixels corresponding to non-foreground objects in the first mask image to a second grayscale value range; determining an outline corresponding to the foreground object in the image according to a grayscale value range difference between the first grayscale value range of the foreground object and the second grayscale value range of the non-foreground objects in the first mask image; and sending, to a client device for display, the image with the determined outline for interaction by a user.
    Type: Grant
    Filed: February 8, 2021
    Date of Patent: December 17, 2024
    Assignee: ALIBABA GROUP HOLDING LIMITED
    Inventors: Jian Cao, Bang Zhang, Yinghui Xu, Pan Pan
  • Patent number: 12148123
    Abstract: An embodiment method includes performing first convolutional filtering on a first tensor constructed using a current frame and reference frames (or digital world reference images) of the current frame in a video, to generate a first estimated image of the current frame having a higher resolution than an image of the current frame. The method also includes performing second convolutional filtering on a second tensor constructed using the first estimated image and estimated reference images of the reference frames, to generate a second estimated image of the current having a higher resolution than the image of the current frame. The estimated reference images of the reference frames are reconstructed high resolution images of the reference images.
    Type: Grant
    Filed: April 28, 2020
    Date of Patent: November 19, 2024
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Fatih Murat Porikli, Ratheesh Kalarot
  • Patent number: 12125581
    Abstract: Apparatuses and computer-implemented methods for compression and extraction of three-dimensional (3D) volumetric imaging data, including in particular medical and dental imaging data, that may receive the 3D volumetric image data and preparing compressed 3D volumetric image data for compression by analyzing a relevant region of the 3D volumetric image data. The method may further include compressing, into compressed 3D volumetric image data, the pre-processed static 3D volumetric image data using a video compression scheme. Various other methods, systems, and computer-readable media are also disclosed.
    Type: Grant
    Filed: February 22, 2021
    Date of Patent: October 22, 2024
    Assignee: Align Technology, Inc.
    Inventors: Yury Slynko, Vitaliy Vladimirovich Chernov, Ilya Baryshnikov
  • Patent number: 12112462
    Abstract: A detection unit configured to detect a detection target from an image to be processed by detection processing capable of adjusting at least one setting, a correction cost estimation unit configured to estimate a correction cost needed for correction needed in a case where a result of detection by the detection unit is corrected, an adjustment cost estimation unit configured to estimate an adjustment cost needed in a case where the setting of the detection processing is adjusted to the detection target, and a display control unit configured to perform control to display the correction cost and the adjustment cost on a display unit in a comparable manner are included.
    Type: Grant
    Filed: May 20, 2021
    Date of Patent: October 8, 2024
    Assignee: Canon Kabushiki Kaisha
    Inventor: Atsushi Nogami
  • Patent number: 12106455
    Abstract: To provide evaluation by using a virtual video image generated by performing an optical image processing for lightness and distortion required by an evaluation object. An evaluation apparatus for a camera system including a camera for capturing a video image of outside view includes: a video generation unit for generating a simulation video image simulating the video image of outside view captured by the camera; an optical filter unit which performs an optical image processing on the simulation video image in order to simulate the video image outputted from the camera; and a camera image processing unit which generates a vehicle control signal by performing a recognition processing by using the processed video image.
    Type: Grant
    Filed: February 7, 2020
    Date of Patent: October 1, 2024
    Assignee: HITACHI ASTEMO, LTD.
    Inventors: Takayoshi Chiyoda, Hiroaki Nakata, Michio Morioka, Masayuki Kanai
  • Patent number: 12087060
    Abstract: A vehicular vision system includes a camera disposed at a vehicle and capturing image data. The system, via processing at an electronic control unit (ECU) of image data captured by the camera, detects an object at a first orientation relative to camera. A first local binary pattern represents in binary form a first portion of the image data that includes the detected object. The system detects the object at a second orientation relative to camera. A second local binary pattern represents in binary form a second portion of the image data that includes the detected object. The second orientation is different from the first orientation and the second local binary pattern is different than the first local binary pattern. The system groups the first and second local binary patterns into a common histogram bin. The system classifies the detected object based at least in part on the common histogram bin.
    Type: Grant
    Filed: September 29, 2021
    Date of Patent: September 10, 2024
    Assignee: Magna Electronics Inc.
    Inventors: Liang Zhang, Tao-I Hsu
  • Patent number: 12079962
    Abstract: A method and system are provided. The method includes obtaining a difference map between a reference frame and a non-reference frame, estimating a noise variance of the obtained difference map, obtaining merging weights based on the estimated noise variance and the obtained different map, and merging the non-reference frame with the reference frame using the obtained merging weights.
    Type: Grant
    Filed: March 29, 2021
    Date of Patent: September 3, 2024
    Assignee: Samsung Electronics Co., Ltd
    Inventors: Mojtaba Rahmati, Dongwoon Bai, Jungwon Lee
  • Patent number: 12051173
    Abstract: Methods and apparatus for blending unknown pixels in overlapping images. In one embodiment, an action camera captures two hyper-hemispherical fisheye images that are stitched to a 360° panorama. In order to remove exposure differences between the two cameras, the images are pre-processed prior to multiband blending. The pre-processing leverages image information from pixels to make informed guesses about pixels that were not captured. In particular, various pixels with different knowability (e.g., known, unknown, consistent, and conflicting) may be handled differently so as to emphasize/de-emphasize their importance in pre-processing.
    Type: Grant
    Filed: April 14, 2021
    Date of Patent: July 30, 2024
    Assignee: GoPro, Inc.
    Inventor: Marc Lebrun
  • Patent number: 12045969
    Abstract: A method includes obtaining at least one 2-D image dataset of semiconductor structures formed on a wafer including one or more defects during a wafer run of a wafer using a predefined fabrication process. The method also includes determining, based on at least one machine-learning algorithm trained on prior knowledge of the fabrication process and based on the at least one 2-D image dataset, one or more process deviations of the wafer run from the predefined fabrication process as a root cause of the one or more defects. A 3-D image dataset may be determined as a hidden variable.
    Type: Grant
    Filed: September 28, 2020
    Date of Patent: July 23, 2024
    Assignee: Carl Zeiss SMT GmbH
    Inventors: Jens Timo Neumann, Eugen Foca, Ramani Pichumani, Abhilash Srikantha, Christian Wojek, Thomas Korb, Joaquin Correa
  • Patent number: 12033321
    Abstract: A system and method for augmenting an original OCT (optical coherence tomography) image includes a controller having a processor and a tangible, non-transitory memory on which instructions are recorded. The system includes one or more learning modules selectively executable by the controller. The learning modules are trained by a training network with a training dataset having a plurality of training ultrasound bio-microscopy images and respective training OCT images. Execution of the instructions by the processor causes the controller to obtain the original OCT image, captured through an OCT device. The controller is configured to generate an augmented OCT image based in part on the original OCT image, by executing the (trained) learning modules. The augmented OCT image at least partially extends a peripheral portion of the original OCT image.
    Type: Grant
    Filed: October 21, 2021
    Date of Patent: July 9, 2024
    Assignee: Alcon Inc.
    Inventors: Sinchan Bhattacharya, Hyo Won Choi, Ramesh Sarangapani, Bryan Stanfill
  • Patent number: 12008784
    Abstract: A method includes defining, in an image, bounding boxes about an electrical connector assembly, identifying an edge of each of the bounding boxes, and determining one or more metrics based on the edge of each the bounding boxes, where the one or more metrics indicate a positional relationship between the edges of the bounding boxes. The method includes determining a state of the electrical connector assembly based on the one or more metrics and transmitting a notification based on the state.
    Type: Grant
    Filed: February 9, 2021
    Date of Patent: June 11, 2024
    Assignee: Ford Global Technologies, LLC
    Inventors: Raj Sohmshetty, Vikas Rajendra
  • Patent number: 11961240
    Abstract: A system and method for detecting motion with respect an object includes providing a processor and at least one video sensor; synchronizing the at least one video sensor to a dynamic event associated with the object; recording, by the at least one video sensor, a plurality of data sets including the object, each data set of the plurality of data sets being synchronized with respect to the dynamic event associated with the object; averaging, by the processor, the plurality of data sets to provide an averaged synchronized data set; and calculating, by the processor, a motion with respect to the object based on the averaged synchronized data set.
    Type: Grant
    Filed: June 11, 2021
    Date of Patent: April 16, 2024
    Assignee: MECHANICAL SOLUTIONS INC.
    Inventor: Timothy Shields
  • Patent number: 11960294
    Abstract: A system includes: a depth module including an encoder and a decoder and configured to: receive a first image from a first time from a camera; and based on the first image, generate a depth map including depths between the camera and objects in the first image; a pose module configured to: generate a first pose of the camera based on the first image; generate a second pose of the camera for a second time based on a second image; and generate a third pose of the camera for a third time based on a third image; and a motion module configured to: determine a first motion of the camera between the second and first times based on the first and second poses; and determine a second motion of the camera between the second and third times based on the second and third poses.
    Type: Grant
    Filed: July 13, 2020
    Date of Patent: April 16, 2024
    Assignees: NAVER CORPORATION, NAVER LABS CORPORATION
    Inventors: Boris Chidlovskii, Assem Sadek
  • Patent number: 11893751
    Abstract: This disclosure relates generally to system and method for forecasting location of target in monocular first person view. Conventional systems for location forecasting utilizes complex neural networks and hence are computationally intensive and requires high compute power. The disclosed system includes an efficient and light-weight RNN based network model for predicting motion of targets in first person monocular videos. The network model includes an auto-encoder in the encoding phase and a regularizing layer in the end helps us get better accuracy. The disclosed method relies entirely just on detection bounding boxes for prediction as well as training of the network model and is still capable of transferring zero-shot on a different dataset.
    Type: Grant
    Filed: August 18, 2021
    Date of Patent: February 6, 2024
    Assignee: Tata Consultancy Services Limited
    Inventors: Junaid Ahmed Ansari, Brojeshwar Bhowmick
  • Patent number: 11887334
    Abstract: The in-vehicle device transfers the selected image selected by the user from the photographed images stored in the storage device and the selected vehicle state, which is the vehicle state when the selected image is captured, to the form terminal. The portable device transmits the selected image and the selected vehicle state to the image management server only when the transmission is permitted by the user. The image management server determines whether or not the selected image is a rare image using the selected image and the selected vehicle state, and stores the selected image in the image storage device when the selected image is determined to be a rare image.
    Type: Grant
    Filed: September 8, 2021
    Date of Patent: January 30, 2024
    Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHA
    Inventors: Katsuhiko Iwazaki, Yu Watanabe
  • Patent number: 11854124
    Abstract: A method for photoacoustic imaging is performed by measuring RF time samples from transducer elements, and reconstructing an estimated initial pressure image from the measured RF time samples and a pre-calculated forward model matrix. The reconstructing involves minimizing the difference between the pre-calculated forward model matrix applied to the image estimate and the measured RF time samples by implementing a superiorized modified conjugate gradient least squares algorithm to minimize the total variation norm. The model matrix factors each of the transducer elements into sub-wavelength mathematical elements.
    Type: Grant
    Filed: November 2, 2021
    Date of Patent: December 26, 2023
    Assignee: The Board of Trustees of the Leland Stanford Junior University
    Inventors: Idan Steinberg, Sanjiv Sam Gambhir