Patents Examined by Chan S. Park
  • Patent number: 11436709
    Abstract: The disclosure provides a 3-dimensional reconstruction method, an electronic device and a storage medium. The method includes: obtaining an image sequence pre-collected by a camera; obtaining nominal intrinsic parameters of the camera, and preset initial values of distortion coefficients of the camera, the camera being a camera for collecting the image sequence; calculating fluctuation ranges of the distortion coefficients; performing the 3D reconstruction on the image sequence based on the nominal intrinsic parameters, the initial values of the distortion coefficients, and the fluctuation ranges of the distortion coefficients; and during the 3D reconstruction, optimizing an obtained visual point cloud and a camera pose.
    Type: Grant
    Filed: October 28, 2020
    Date of Patent: September 6, 2022
    Assignee: APOLLO INTELLIGENT DRIVING TECHNOLOGY (BEIJING) CO., LTD.
    Inventors: Yuzhan Cai, Chao Zheng, Chao Yan, Hantian Zhang
  • Patent number: 11423559
    Abstract: In one embodiment, a method includes receiving, by an object reconstruction module, a first image and a second image. The first image includes a first region of an object and the second image comprises a second region of the object. The method also includes identifying, by the object reconstruction module, a transitional image. The transitional image includes the first region of the object and the second region of the object. The method further includes determining, by the object reconstruction module, that the first region of the object in the transitional image and the first region of the object in the first image are equivalent regions and generating, by the object reconstruction module, a reconstruction of the object using the first image and the transitional image. The reconstruction of the object includes the first region of the object and the second region of the object and excludes equivalent regions.
    Type: Grant
    Filed: June 30, 2020
    Date of Patent: August 23, 2022
    Assignee: BNSF Railway Company
    Inventor: Rachel Kohler
  • Patent number: 11398007
    Abstract: A video of a shadow is automatically generated to create an illusion that a region included in a real object floats above a background and an apparent height of the region with respect to a background region changes with time. A video generation device receives input of a dark region image including a dark region that is a spatial region corresponding to a target object and is darker than a background, and control information for specifying a motion to be given to the dark region, and obtains and outputs a video including a shadow region is obtained and output. The shadow region is obtained by performing mask processing on a motion region obtained by giving the motion to the dark region according to the control information. The mask processing replaces pixels of a mask region at a spatial position corresponding to the target object with pixels brighter than the motion region.
    Type: Grant
    Filed: April 2, 2019
    Date of Patent: July 26, 2022
    Assignee: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
    Inventor: Takahiro Kawabe
  • Patent number: 11393123
    Abstract: An information processing device finds a position/orientation of an image capturing unit including first and second cameras whose image capturing fields are partially overlapped, the information processing device comprises an input unit that inputs first and second images from the first and second cameras a holding unit holding a learning model; a first estimating unit that estimates first provisional geometric information from the first and second images; a second estimating unit that estimates second provisional geometric information on the basis of the first image and the learning model; a third estimating unit that estimates third provisional geometric information on the basis of the second image and the learning model; and a generating unit that, on the basis of the first, second, and third provisional geometric information, generates the position/orientation information of the image capturing unit.
    Type: Grant
    Filed: July 6, 2020
    Date of Patent: July 19, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Tomoaki Higo, Daisuke Kotake, Masahiro Suzuki, Nozomu Kasuya, Makoto Tomioka
  • Patent number: 11361532
    Abstract: Some implementations of the present disclosure are directed to a computer-implemented method that includes: detecting a plurality of characters from a photo of an object; generating a set of character-based features based on the plurality of characters; matching the set of character-based features with a template of feature sets obtained from known objects; based on a matching set of character-based features, establishing a matching transformation between the object in the photo and the template of feature sets; and projecting the matching transformation to the photo such that the object is segmented from the photo.
    Type: Grant
    Filed: April 30, 2020
    Date of Patent: June 14, 2022
    Assignee: Idemia Identity & Security USA LLC
    Inventors: Brian K. Martin, Joseph Mayer, Rein-Lien Hsu
  • Patent number: 11326870
    Abstract: Systems and methods for imaging based on multiple cross-sectional images acquired at different angles are disclosed. According to an aspect, multiple cross-sectional images of an object are acquired at different angles. The method also includes registering the acquired cross-sectional images. Further, the method includes reconstructing an enhanced resolution image of the object based on the registered images. As a result of registering the images, a distortion map is generated that is coregistered with the high-resolution image. The method also includes displaying an image of the object based on the enhanced resolution image and the distortion map.
    Type: Grant
    Filed: January 29, 2019
    Date of Patent: May 10, 2022
    Assignee: Duke University
    Inventors: Joseph Izatt, Ruobing Qian, Sina Farsiu, Kevin Zhou
  • Patent number: 11328389
    Abstract: The computing technologies include a processor in communication with a sensing device and with an imaging device. The sensing device and the imaging device input a set of sensing data and a set of imaging data respectively into the processor such that the processor is able to determine whether a vehicle is present within an operational area. If so, then the processor is able to stitch a set of frames from the set of imaging data for subsequent recordation into a storage device.
    Type: Grant
    Filed: December 21, 2018
    Date of Patent: May 10, 2022
    Inventor: Vladimir Petruk
  • Patent number: 11324401
    Abstract: A computing system for wound tracking is disclosed herein. A server computing device receives a first image of a wound of a patient captured by a first camera. Subsequently, the server computing device receives a message generated by a computing device, the message indicating that a second camera of the computing device is to capture a second image of the wound. Responsive to receiving the message, the server computing device causes data to be transmitted to the computing device, the data based in part upon the first image. The data causes the computing device to present a semi-transparent overlay to a view of the wound on a display as perceived through a lens of the second camera, the semi-transparent overlay indicative of the first image. The computing device captures the second image via the second camera and causes the second image to be received by the server computing device.
    Type: Grant
    Filed: September 5, 2019
    Date of Patent: May 10, 2022
    Assignee: ALLSCRIPTS SOFTWARE, LLC
    Inventors: Joshua Brown, David Windell
  • Patent number: 11321848
    Abstract: A method with video segmentation may include: acquiring, over time, a video sequence including a plurality of image frames, the plurality of image frames including a second image frame corresponding to a time t of the video sequence and a first image frame corresponding to a time t?1 before the time t; extracting a second feature vector from the second image frame; generating second hidden state information corresponding to the second image frame, based on first hidden state information corresponding to the first image frame and second fusion information in which the second feature vector is fused with information related to the second image frame stored in a memory; generating a second segmentation mask corresponding to the second image frame, based on an output vector corresponding to the second hidden state information; and outputting the second segmentation mask.
    Type: Grant
    Filed: June 12, 2020
    Date of Patent: May 3, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Seungin Park, Seokhwan Jang
  • Patent number: 11323674
    Abstract: A projection device including a processor circuit is provided. The processor circuit generates multiple warped feature points according to multiple first feature points and multiple second feature points. The processor circuit transforms a first mapping table into a second mapping table according to the warped feature points. The projection device projects a correction pattern to a projection screen. The correction pattern includes the first feature points. The processor circuit receives an image of the correction pattern projected to the projection screen that is captured by a 3D image capturing device, so as to obtain coordinate positions of the second feature points. The processor circuit calculates a viewer position according to the coordinate positions of the second feature points. The processor circuit generates an antiwarp image according to an input image and the second mapping table. The projection device projects the antiwarp image to the projection screen.
    Type: Grant
    Filed: July 28, 2019
    Date of Patent: May 3, 2022
    Assignee: Coretronic Corporation
    Inventor: Pei-Chi Hsiao
  • Patent number: 11308576
    Abstract: In accordance with implementations of the subject matter described herein, there is proposed a solution of visual stylization of stereoscopic images. In the solution, a first feature map for a first source image and a second feature map for a second source image are extracted. The first and second source images correspond to first and second views of a stereoscopic image, respectively. A first unidirectional disparity from the first source image to the second source image is determined based on the first and second source images. First and second target images having a specified visual style are generated by processing the first and second feature maps based on the first unidirectional disparity. Through the solution, a disparity between two source images of a stereoscopic image are taken into account when performing the visual style transfer, thereby maintaining a stereoscopic effect in the stereoscopic image consisting of the target images.
    Type: Grant
    Filed: January 8, 2019
    Date of Patent: April 19, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Lu Yuan, Gang Hua, Jing Liao, Dongdong Chen
  • Patent number: 11301968
    Abstract: Captured images of a scene may include depictions of objects moving within the scene. The portions of the images depicting the moving objects may be identified by aligning the images and analyzing the changes in pixel values of the aligned images. For the portion of the images depicting the moving objects, the pixels values may be replaced with mean, mode, and/or median values that approximate the value that would have been captured without the moving objects, and one or more image without the depiction of moving objects may be generated.
    Type: Grant
    Filed: August 26, 2020
    Date of Patent: April 12, 2022
    Assignee: GoPro, Inc.
    Inventors: Marc Lebrun, Maxim Karpushin, Nicolas Rahmouni
  • Patent number: 11282164
    Abstract: Systems and methods of video inpainting for autonomous driving are disclosed. For example, the method stitches a multiplicity of depth frames into a 3D map, where one or more objects in the depth frames have previously been removed. The method further projects the 3D map onto a first image frame to generate a corresponding depth map, where the first image frame includes a target inpainting region. For each target pixel within the target inpainting region of the first image frame, based on the corresponding depth map, the method further maps the target pixel within the target inpainting region of the first image frame to a candidate pixel in a second image frame. The method further determines a candidate color to fill the target pixel. The method further performs Poisson image editing on the first image frame to achieve color consistency at a boundary and between inside and outside of the target inpainting region of the first image frame.
    Type: Grant
    Filed: May 26, 2020
    Date of Patent: March 22, 2022
    Assignees: BAIDU USA LLC, BAIDU.COM TIMES TECHNOLOGY (BEIJING) CO., LTD.
    Inventors: Miao Liao, Feixiang Lu, Dingfu Zhou, Sibo Zhang, Ruigang Yang
  • Patent number: 11232569
    Abstract: Devices, systems, computer program products and computer implemented methods are provided for dynamically assessing a moving object from a sequence of consecutive volumetric image frames of such object, which images are timely separated by a certain time interval, by: identifying in at least one image of the sequence the object of interest; segmenting the object to identify object contour; propagating the object contour as identified to other images of the sequence; and performing dynamic analysis of the object based on the object contour as propagated.
    Type: Grant
    Filed: September 5, 2019
    Date of Patent: January 25, 2022
    Assignee: 3mensio Medical Imaging B.V.
    Inventors: Jan Anne Niels de Vaan, Peter Heil, Arjen Witteveen, Martijn L. Laurentius Chatrou
  • Patent number: 11222433
    Abstract: Provided are a method and apparatus for calculating three-dimensional coordinates using photographic images, and more particularly, a method and apparatus for calculating three-dimensional coordinates using photographic images in which a plurality of photographic images are analyzed to calculate the three-dimensional coordinate of a point commonly marked on the photographic images. By using the method and apparatus for calculating three-dimensional coordinates using photographic images captured by a camera, three-dimensional coordinates of arbitrary points marked on the photographic images can be easily calculated.
    Type: Grant
    Filed: June 12, 2020
    Date of Patent: January 11, 2022
    Assignee: CUPIX, INC.
    Inventors: SeockHoon Bae, Jun Young Park
  • Patent number: 11217100
    Abstract: Provided are an electronic device and method for assisting with driving of a vehicle, the electronic device including: a sensing unit configured to sense a driving state of at least one external vehicle on an entry scheduled lane that the vehicle is to enter by changing lanes; a processor configured to determine an entry possible region on the entry scheduled lane based on the sensed driving state of the at least one external vehicle and determine an entry condition for entry of the vehicle into the entry possible region; and an outputter configured to output information about the entry possible region and the entry condition.
    Type: Grant
    Filed: February 2, 2018
    Date of Patent: January 4, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Jin-woo Yoo, Jung-gap Kuk, A-ron Baik, Min-sung Jang, Jung-un Lee
  • Patent number: 11210796
    Abstract: An imaging method includes determining a target position in an imaging frame of an image capturing mechanism connected with a positioning mechanism, outputting a capturing instruction to control the image capturing mechanism to capture a scene including a human face after the target position is determined, detecting the human face from the captured scene, and outputting a control instruction to position the detected human face at the target position by moving the positioning mechanism to move the image capturing mechanism.
    Type: Grant
    Filed: September 9, 2019
    Date of Patent: December 28, 2021
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Xuyang Feng, Cong Zhao, Junfeng Yu, Jie Qian
  • Patent number: 11205252
    Abstract: A method and a device for enhancing brightness and contrast of a video image are provided. In the method, an inflection point, a truncation point, a maximum value of a brightness component, and a minimum value of the brightness component of an image frame to be processed are determined based on the brightness component of the image frame to be processed, a piecewise linear function is determined based on the inflection point, and brightness and contrast enhancement processing is performed on the image frame to be processed based on the piecewise linear function. Compared with the brightness and contrast enhancement method in conventional art, the method and device of the application can achieve better brightness and contrast enhancement effects.
    Type: Grant
    Filed: December 16, 2019
    Date of Patent: December 21, 2021
    Assignee: SHENZHEN LONTIUM SEMICONDUCTOR TECHNOLOGY CO., LTD.
    Inventors: Xu Sun, Jixing Ye, Wenhan Yin, Ligang Hu, Shiyong Liang, Changfang Yue, Rongliang Yu
  • Patent number: 11200691
    Abstract: Systems and methods for optical sensing, visualization and detection in media (e.g., turbid media; turbid water; fog; non-turbid media). A light source and an image sensor are positioned in turbid media or external to the turbid media with the light source within a field of view of the image sensor array. Temporal optical signals are transmitted through the turbid media via the light source and multiple perspective video sequence frames are acquired via the image sensor array of light propagating through the turbid media. A three-dimensional image is reconstructed from each frame and the reconstructed three-dimensional images are combined to form a three-dimensional video sequence. The transmitted optical signals are detected from the three-dimensional video sequence by applying a multi-dimensional signal detection scheme.
    Type: Grant
    Filed: May 29, 2020
    Date of Patent: December 14, 2021
    Assignee: UNIVERSITY OF CONNECTICUT
    Inventors: Bahram Javidi, Satoru Komatsu, Adam Markman
  • Patent number: 11182921
    Abstract: This wire shape inspecting apparatus comprises a camera which captures an image of a wire from above, a light which illuminates the wire from above, and a control unit, wherein the control unit performs: an inspection image acquiring process of acquiring a plurality of inspection images by causing the camera to capture images of the wire a plurality of times while changing a focal distance; and a first shape detecting process of identifying, in each inspection image, a light emitting portion, which is an image part including reflected light comprising light from the light that has been reflected by the wire, and identifying an actual light emitting portion position, which is the actual position of the light emitting portion, on the basis of the position of the light emitting portion in the inspection image and the focal distance when the inspection image was acquired.
    Type: Grant
    Filed: December 20, 2018
    Date of Patent: November 23, 2021
    Assignee: SHINKAWA LTD.
    Inventor: Shigeru Amemiya