Patents Examined by Daniel C Chang
  • Patent number: 11532070
    Abstract: A set of input images from satellites (or other remote sensors) can be orthorectified and stitched together to create a mosaic. If the resulting mosaic is not of suitable quality, the input images can be adjusted and the processes of orthorectifying and creating the mosaic can be repeated. However, orthorectifying and creating the mosaic uses a large amount of computational resources and takes a lot of time. Therefore, performing numerous iterations is expensive and sometimes not practical. To overcome these issues, it is proposed to generate an indication of accuracy of the resulting mosaic prior to orthorectifying and creating the mosaic by accessing a set of points in the plurality of input images, projecting the points to a model, determining residuals for the projected points, and generating the indication of accuracy of the orthorectified mosaic based on the determined residuals.
    Type: Grant
    Filed: February 2, 2021
    Date of Patent: December 20, 2022
    Assignee: Maxar Intelligence Inc.
    Inventors: Steven F. Hartung, Wolfgang Schickler, Nathan Swanson, Laurence C. Bleiler
  • Patent number: 11514377
    Abstract: The present invention discloses a space allocation system and a method for allocating space to objects with multi-variate characteristics. In the present invention, intra-container allocation and/or inter-container allocation is performed to generate a combination in which the objects can be placed in one or more pre-defined storage spaces in a plurality of storage containers. The generated combination is further optimized for efficient space allocation to objects with multi-variate characteristics.
    Type: Grant
    Filed: September 9, 2019
    Date of Patent: November 29, 2022
    Assignee: Amadeus S.A.S.
    Inventors: Eldho Abraham, Suresh Yerva
  • Patent number: 11508077
    Abstract: A processor-implemented method of detecting a moving object includes: estimating a depth image of a current frame; determining an occlusion image of the current frame by calculating a depth difference value between the estimated depth image of the current frame and an estimated depth image of a previous frame; determining an occlusion accumulation image of the current frame by adding a depth difference value of the occlusion image of the current frame to a depth difference accumulation value of an occlusion accumulation image of the previous frame; and outputting an area of a moving object based on the occlusion accumulation image.
    Type: Grant
    Filed: February 4, 2021
    Date of Patent: November 22, 2022
    Assignees: Samsung Electronics Co., Ltd., SNU R&DB FOUNDATION
    Inventors: Hyoun Jin Kim, Haram Kim
  • Patent number: 11508044
    Abstract: A method for translating an image, a method for training an image translation model, and related electronic devices are proposed. In the method for translating an image, an image translation request carrying an original image is obtained. A down-sampled image is generated by down sampling the original image. A pre-translated image, a mask image, and deformation parameters are generated based on the down-sampled image. A size of the pre-translated image and a size of the mask image are the same as a size of the original image. A deformed image is obtained by deforming original image based on the deformation parameters. The deformed image, the pre-translated image and the mask image are fused to generate a target translation image.
    Type: Grant
    Filed: December 9, 2020
    Date of Patent: November 22, 2022
    Assignee: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
    Inventors: Shaoxiong Yang, Chen Zhao
  • Patent number: 11501465
    Abstract: Systems and methods for macro stereo time-lapse photography, producing a stereographic time-lapse digital video, and macro stereographic time-lapse digital videos. A method of producing a sequence of time-lapse stereographic images of a subject, by positioning a camera with a macro lens at a first position relative to the subject; using the camera to obtain a first stack of images of the subject from the first position; positioning the camera at a second position relative to the subject; using the camera to obtain a second stack of images of the subject from the second position; and storing the first stack of images and the second stack of images as a stack pair; and then selectively repeating.
    Type: Grant
    Filed: May 3, 2019
    Date of Patent: November 15, 2022
    Assignee: WITHIN UNLIMITED, INC.
    Inventor: Aaron Koblin
  • Patent number: 11481877
    Abstract: In one embodiment, a method includes accessing first-resolution images corresponding to frames of a video, computing a motion vector based on a first-resolution image of a first frame in the video and a first-resolution image of a second frame in the video, generating a second-resolution warped image associated with the second frame by using the motion vector to warp a second-resolution reconstructed image associated with the first frame, generating a second-resolution intermediate image associated with the second frame based on the first-resolution image associated with the second frame, computing adjustment parameters by processing the first-resolution image associated with the second frame and the second-resolution warped image associated with the second frame using a machine-learning model, and adjusting pixels of the second-resolution intermediate image associated with the second frame based on the adjustment parameters to reconstruct a second-resolution reconstructed image associated with the second fra
    Type: Grant
    Filed: June 16, 2020
    Date of Patent: October 25, 2022
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Mikhail Okunev, Anton S. Kaplanyan
  • Patent number: 11450013
    Abstract: A method for acquiring a sample image set, includes: acquiring a plurality of frame images continuously shot for a shooting scene; determining, as a reference image, one frame of a plurality of frame images, and determining, as non-reference images, remaining ones of the plurality of frame images other than the one determined as the reference image; performing a format conversion on the reference image and the non-reference images to obtain a format-converted reference image and format-converted non-reference images, and performing a noise addition processing on the format-converted reference image and each non-reference image respectively; aligning each noise-added non-reference image with a noise-added reference image to obtain an aligned non-reference image; annotating the format-converted reference image with pixel information to obtain a non-noise-added reference image; and acquiring the sample image set, the sample image set including the aligned non-reference image, the noise-added reference image, and
    Type: Grant
    Filed: July 16, 2020
    Date of Patent: September 20, 2022
    Assignee: Beijing Xiaomi Pinecone Electronics Co., Ltd.
    Inventors: Weihang Yuan, Jin Wang, Taolue Feng
  • Patent number: 11443410
    Abstract: An image processing method includes a matching cost calculating process of calculating matching costs in a unit of sub-pixels having higher resolution than first and second images by using an image of a reference area contained in the first image in which a target object is imaged and images of a plurality of comparison areas contained in the second image in which the target object is imaged, and a synthesized cost calculating process of calculating synthesized costs related to the reference area based on comparison results of values related to the plurality of matching costs calculated in the matching cost calculating process.
    Type: Grant
    Filed: October 2, 2020
    Date of Patent: September 13, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Hiroto Mizohana, Keita Dan
  • Patent number: 11436709
    Abstract: The disclosure provides a 3-dimensional reconstruction method, an electronic device and a storage medium. The method includes: obtaining an image sequence pre-collected by a camera; obtaining nominal intrinsic parameters of the camera, and preset initial values of distortion coefficients of the camera, the camera being a camera for collecting the image sequence; calculating fluctuation ranges of the distortion coefficients; performing the 3D reconstruction on the image sequence based on the nominal intrinsic parameters, the initial values of the distortion coefficients, and the fluctuation ranges of the distortion coefficients; and during the 3D reconstruction, optimizing an obtained visual point cloud and a camera pose.
    Type: Grant
    Filed: October 28, 2020
    Date of Patent: September 6, 2022
    Assignee: APOLLO INTELLIGENT DRIVING TECHNOLOGY (BEIJING) CO., LTD.
    Inventors: Yuzhan Cai, Chao Zheng, Chao Yan, Hantian Zhang
  • Patent number: 11423559
    Abstract: In one embodiment, a method includes receiving, by an object reconstruction module, a first image and a second image. The first image includes a first region of an object and the second image comprises a second region of the object. The method also includes identifying, by the object reconstruction module, a transitional image. The transitional image includes the first region of the object and the second region of the object. The method further includes determining, by the object reconstruction module, that the first region of the object in the transitional image and the first region of the object in the first image are equivalent regions and generating, by the object reconstruction module, a reconstruction of the object using the first image and the transitional image. The reconstruction of the object includes the first region of the object and the second region of the object and excludes equivalent regions.
    Type: Grant
    Filed: June 30, 2020
    Date of Patent: August 23, 2022
    Assignee: BNSF Railway Company
    Inventor: Rachel Kohler
  • Patent number: 11398007
    Abstract: A video of a shadow is automatically generated to create an illusion that a region included in a real object floats above a background and an apparent height of the region with respect to a background region changes with time. A video generation device receives input of a dark region image including a dark region that is a spatial region corresponding to a target object and is darker than a background, and control information for specifying a motion to be given to the dark region, and obtains and outputs a video including a shadow region is obtained and output. The shadow region is obtained by performing mask processing on a motion region obtained by giving the motion to the dark region according to the control information. The mask processing replaces pixels of a mask region at a spatial position corresponding to the target object with pixels brighter than the motion region.
    Type: Grant
    Filed: April 2, 2019
    Date of Patent: July 26, 2022
    Assignee: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
    Inventor: Takahiro Kawabe
  • Patent number: 11393123
    Abstract: An information processing device finds a position/orientation of an image capturing unit including first and second cameras whose image capturing fields are partially overlapped, the information processing device comprises an input unit that inputs first and second images from the first and second cameras a holding unit holding a learning model; a first estimating unit that estimates first provisional geometric information from the first and second images; a second estimating unit that estimates second provisional geometric information on the basis of the first image and the learning model; a third estimating unit that estimates third provisional geometric information on the basis of the second image and the learning model; and a generating unit that, on the basis of the first, second, and third provisional geometric information, generates the position/orientation information of the image capturing unit.
    Type: Grant
    Filed: July 6, 2020
    Date of Patent: July 19, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Tomoaki Higo, Daisuke Kotake, Masahiro Suzuki, Nozomu Kasuya, Makoto Tomioka
  • Patent number: 11361532
    Abstract: Some implementations of the present disclosure are directed to a computer-implemented method that includes: detecting a plurality of characters from a photo of an object; generating a set of character-based features based on the plurality of characters; matching the set of character-based features with a template of feature sets obtained from known objects; based on a matching set of character-based features, establishing a matching transformation between the object in the photo and the template of feature sets; and projecting the matching transformation to the photo such that the object is segmented from the photo.
    Type: Grant
    Filed: April 30, 2020
    Date of Patent: June 14, 2022
    Assignee: Idemia Identity & Security USA LLC
    Inventors: Brian K. Martin, Joseph Mayer, Rein-Lien Hsu
  • Patent number: 11326870
    Abstract: Systems and methods for imaging based on multiple cross-sectional images acquired at different angles are disclosed. According to an aspect, multiple cross-sectional images of an object are acquired at different angles. The method also includes registering the acquired cross-sectional images. Further, the method includes reconstructing an enhanced resolution image of the object based on the registered images. As a result of registering the images, a distortion map is generated that is coregistered with the high-resolution image. The method also includes displaying an image of the object based on the enhanced resolution image and the distortion map.
    Type: Grant
    Filed: January 29, 2019
    Date of Patent: May 10, 2022
    Assignee: Duke University
    Inventors: Joseph Izatt, Ruobing Qian, Sina Farsiu, Kevin Zhou
  • Patent number: 11328389
    Abstract: The computing technologies include a processor in communication with a sensing device and with an imaging device. The sensing device and the imaging device input a set of sensing data and a set of imaging data respectively into the processor such that the processor is able to determine whether a vehicle is present within an operational area. If so, then the processor is able to stitch a set of frames from the set of imaging data for subsequent recordation into a storage device.
    Type: Grant
    Filed: December 21, 2018
    Date of Patent: May 10, 2022
    Inventor: Vladimir Petruk
  • Patent number: 11324401
    Abstract: A computing system for wound tracking is disclosed herein. A server computing device receives a first image of a wound of a patient captured by a first camera. Subsequently, the server computing device receives a message generated by a computing device, the message indicating that a second camera of the computing device is to capture a second image of the wound. Responsive to receiving the message, the server computing device causes data to be transmitted to the computing device, the data based in part upon the first image. The data causes the computing device to present a semi-transparent overlay to a view of the wound on a display as perceived through a lens of the second camera, the semi-transparent overlay indicative of the first image. The computing device captures the second image via the second camera and causes the second image to be received by the server computing device.
    Type: Grant
    Filed: September 5, 2019
    Date of Patent: May 10, 2022
    Assignee: ALLSCRIPTS SOFTWARE, LLC
    Inventors: Joshua Brown, David Windell
  • Patent number: 11321848
    Abstract: A method with video segmentation may include: acquiring, over time, a video sequence including a plurality of image frames, the plurality of image frames including a second image frame corresponding to a time t of the video sequence and a first image frame corresponding to a time t?1 before the time t; extracting a second feature vector from the second image frame; generating second hidden state information corresponding to the second image frame, based on first hidden state information corresponding to the first image frame and second fusion information in which the second feature vector is fused with information related to the second image frame stored in a memory; generating a second segmentation mask corresponding to the second image frame, based on an output vector corresponding to the second hidden state information; and outputting the second segmentation mask.
    Type: Grant
    Filed: June 12, 2020
    Date of Patent: May 3, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Seungin Park, Seokhwan Jang
  • Patent number: 11323674
    Abstract: A projection device including a processor circuit is provided. The processor circuit generates multiple warped feature points according to multiple first feature points and multiple second feature points. The processor circuit transforms a first mapping table into a second mapping table according to the warped feature points. The projection device projects a correction pattern to a projection screen. The correction pattern includes the first feature points. The processor circuit receives an image of the correction pattern projected to the projection screen that is captured by a 3D image capturing device, so as to obtain coordinate positions of the second feature points. The processor circuit calculates a viewer position according to the coordinate positions of the second feature points. The processor circuit generates an antiwarp image according to an input image and the second mapping table. The projection device projects the antiwarp image to the projection screen.
    Type: Grant
    Filed: July 28, 2019
    Date of Patent: May 3, 2022
    Assignee: Coretronic Corporation
    Inventor: Pei-Chi Hsiao
  • Patent number: 11308576
    Abstract: In accordance with implementations of the subject matter described herein, there is proposed a solution of visual stylization of stereoscopic images. In the solution, a first feature map for a first source image and a second feature map for a second source image are extracted. The first and second source images correspond to first and second views of a stereoscopic image, respectively. A first unidirectional disparity from the first source image to the second source image is determined based on the first and second source images. First and second target images having a specified visual style are generated by processing the first and second feature maps based on the first unidirectional disparity. Through the solution, a disparity between two source images of a stereoscopic image are taken into account when performing the visual style transfer, thereby maintaining a stereoscopic effect in the stereoscopic image consisting of the target images.
    Type: Grant
    Filed: January 8, 2019
    Date of Patent: April 19, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Lu Yuan, Gang Hua, Jing Liao, Dongdong Chen
  • Patent number: 11301981
    Abstract: There are provided a method of vehicle inspection and a system thereof, the method comprising: obtaining a plurality of sets of images capturing a plurality of segments of surface of a vehicle at a plurality of time points; generating, for each time point, a 3D patch using a set of images capturing a corresponding segment at the time point, giving rise to a plurality of 3D patches; estimating 3D transformation of the plurality of 3D patches based on a relative movement between the imaging devices and the vehicle; and registering the plurality of 3D patches using the estimated 3D transformation thereby giving rise to a composite 3D point cloud of the vehicle. The composite 3D point cloud is usable for reconstructing a 3D mesh and/or 3D model of the vehicle where light reflection, comprised in at least some of the plurality of sets of images, is eliminated therefrom.
    Type: Grant
    Filed: March 26, 2019
    Date of Patent: April 12, 2022
    Assignee: UVEYE LTD.
    Inventors: Amir Hever, Dvir Paravi, Ilya Grinshpoun, Ohad Hever