Registering Or Aligning Multiple Images To One Another Patents (Class 382/294)
  • Patent number: 11457152
    Abstract: A device includes an image sensor and an array of optical channels, each optical channel including an optic for projecting a partial field of view of a total field of view onto an image sensor area of the image sensor. A first optical channel of the array is configured to image a first partial field of view of the total field of view. A second optical channel of the array is configured to image a second partial field of view of the total field of view. The device includes a calculating unit configured to obtain image information of the first and second partial fields of view on the basis of the imaged partial fields of view, and to obtain image information of the total field of view, and to combine the image information of the partial fields of view with the image information of the total field of view so as to generate combined image information of the total field of view.
    Type: Grant
    Filed: September 27, 2019
    Date of Patent: September 27, 2022
    Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
    Inventors: Frank Wippermann, Andreas Brückner, Jacques Duparré, Alexander Oberdörster
  • Patent number: 11423082
    Abstract: Methods, apparatus, systems and articles of manufacture are disclosed to analyze graph information. An example apparatus includes a graph computational processor. The example graph computational processor is configured to analyze a first graph with respect to a second graph to identify a third graph within the first graph by: matching a first triplet from the first graph to a second triplet from the second graph by comparing each node and connecting edge included in each triplet; and generating the third graph by adding, when the first triplet matches the second triplet, the first triplet to a subgraph output set forming the third graph. The example graph computational processor of is configured to identify an additional node in the first graph based on the third graph and generate an output based on the additional node.
    Type: Grant
    Filed: June 29, 2016
    Date of Patent: August 23, 2022
    Assignee: Intel Corporation
    Inventors: Nikita M. Vikhe, Sanjay V. Addicam
  • Patent number: 11423631
    Abstract: Colored three-dimensional digital model generation techniques and systems are described. In one example, scanning techniques are employed by a scanning system that scans a physical object while disposed within packaging to form a three-dimension digital model. A model coloring system is employed to color the three-dimensional digital model. A two-dimensional digital image is employed that captures the same or similar physical object. In one example, features of the model are matched to the image. This is then used to align a viewing perspective with respect to the model with a viewing perspective of the object within the digital image, e.g., to find which “view” of the model corresponds with the image. The color is then applied from the digital image to the model, e.g., from pixels of the image to corresponding points in the model.
    Type: Grant
    Filed: July 14, 2020
    Date of Patent: August 23, 2022
    Assignee: eBay Inc.
    Inventor: Yo Han Park
  • Patent number: 11417014
    Abstract: Embodiments of the present disclosure provides a method and apparatus for constructing a map. The method may include: determining pose information of each panoramic image frame from a panoramic image sequence of a target area, and determining a perspective image sequence from each panoramic image frame; determining a feature track corresponding to the panoramic image sequence based on perspective image sequences corresponding to adjacent panoramic image frames; and constructing a visual map of the target area based on the feature track and the pose information of each panoramic image frame.
    Type: Grant
    Filed: September 14, 2020
    Date of Patent: August 16, 2022
    Assignee: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
    Inventors: Zhihao Wang, Chenxu Zhao, Ziwen Qin
  • Patent number: 11373319
    Abstract: An example disclosed method includes (i) transmitting a first point cloud to a client, wherein the first point cloud corresponds to a reference point cloud, (ii) receiving a second point cloud, and (iii) hierarchically determining changes in the second point cloud from the reference point cloud, wherein hierarchically determining the changes includes (a) identifying first areas in the second point cloud that have changed from the reference point cloud, and (b) for a first area having a highest priority, determining a first rigid 3D transformation that approximates a first change from the reference point cloud, and if the first rigid 3D transformation cannot be determined, further determining first points to be used to modify the reference point cloud, wherein the first points are representative of the first change.
    Type: Grant
    Filed: March 19, 2019
    Date of Patent: June 28, 2022
    Assignee: InterDigital Madison Patent Holdings, SAS
    Inventor: Tatu V. J. Harviainen
  • Patent number: 11366836
    Abstract: Geospatial data is gathered for generation of a geodatacube encompassing data from multiple geospatial data sets for efficient processing and optimization. A method for gathering, storing and processing geospatial data includes identifying a plurality of geospatial data sets for intake, each defining a geospatial data parameter. For each geospatial data set, a plurality of subregions is defined such that each subregion corresponds to a portion of the geographic entity having the same value for the data parameter defined by the respective geospatial data set. In other words, subdividing the geographic entity along demarcations defined by variances in the data parameter(s) defined by the geospatial data set. A number of geospatial data sets for intake are arranged into layers, where each layer defines the data parameter for the respective subregions of the geographic entity. A partition defining polygons common to all layers represents a union of the subregions.
    Type: Grant
    Filed: September 19, 2019
    Date of Patent: June 21, 2022
    Assignee: Paper Crane, LLC
    Inventor: David Berthiaume
  • Patent number: 11363214
    Abstract: Image signal processing includes generating an exposure compensated image based on a gain value applied to an exposure level of a first image and a gain value applied to an exposure level of a second image. The gain value may be progressively increased from an approximate center of the first image to an edge of the first image to a common exposure level. The gain value may be progressively decreased from an approximate center of the second image to an edge of the second image to the common exposure level. Gain values may be scaled on each color channel for a pixel based on a saturation level of the pixel.
    Type: Grant
    Filed: October 17, 2018
    Date of Patent: June 14, 2022
    Assignee: GoPro, Inc.
    Inventors: Guillaume Matthieu Guérin, Michel Auger, Karl Krissian
  • Patent number: 11347689
    Abstract: Event ordering is provided in a distributed file system. For instance, events are generated that are associated with an object collected from nodes in the distributed file system, and an event loop indicates causal dependencies among the events, and comprises one or more reliable edges and unreliable edges. Degrees of reliability of the unreliable edges in the event loop are determined, and then at least one unreliable edge is removed from the event loop based on the determined degrees of reliability. Causal dependencies among the events in the distributed file system are analyzed by using a statistical method, and the most unreliable edge in the event loop can be removed by computing a degree of reliability of each unreliable edge, thereby avoiding the occurrence of the event loop.
    Type: Grant
    Filed: March 25, 2020
    Date of Patent: May 31, 2022
    Assignee: EMC IP HOLDING COMPANY LLC
    Inventor: Tianyu Ma
  • Patent number: 11348242
    Abstract: A prediction apparatus includes a learning section that performs machine learning in which, with respect to a combination of different types of captured images obtained by imaging the same subject, one captured image is set to an input and another captured image is set to an output to generate a prediction model; and a controller that performs a control for inputting a first image to the prediction model as an input captured image and outputting a predicted second image that is a captured image having a type different from that of the input captured image.
    Type: Grant
    Filed: April 1, 2019
    Date of Patent: May 31, 2022
    Assignee: FUJIFILM Corporation
    Inventor: Yoshiro Kitamura
  • Patent number: 11348216
    Abstract: Technologies for determining the accuracy of three-dimensional models include a device having circuitry to obtain two-dimensional images of an anatomical object (e.g., a bone of a human joint), to obtain a candidate three-dimensional model of the anatomical object, and to produce two-dimensional silhouettes of the candidate three-dimensional model. The circuitry is also to apply an edge detection algorithm to the two-dimensional images to produce corresponding edge images and to compare the two-dimensional silhouettes to the edge images to produce a score indicative of an accuracy of the candidate three-dimensional model.
    Type: Grant
    Filed: September 27, 2019
    Date of Patent: May 31, 2022
    Assignee: DePuy Synthes Products, Inc.
    Inventors: Shawnoah S. Pollock, R. Patrick Courtis
  • Patent number: 11341742
    Abstract: A method of estimating a self-location of a vehicle includes obtaining an omnidirectional image by using an omnidirectional camera photographing a ground around a driving vehicle at a current location of the driving vehicle, estimating the current location of the driving vehicle on the basis of a global positioning system (GPS) satellite signal received from a satellite, searching a satellite image database storing a satellite image obtained by photographing the ground with the satellite to determine candidate satellite images corresponding to the estimated current location of the driving vehicle, comparing the omnidirectional image with each of the determined candidate satellite images to determine a candidate satellite image having a highest similarity to the omnidirectional image from among the determined candidate satellite images, and finally estimating the current location of the driving vehicle by using a location measurement value mapped to the determined candidate satellite image.
    Type: Grant
    Filed: November 26, 2019
    Date of Patent: May 24, 2022
    Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
    Inventor: Joo Chan Sohn
  • Patent number: 11340632
    Abstract: A georeferenced trajectory estimation system receives data generated by vehicle sensors from a fleet of vehicles and identifies sets of sensor measurements for a geographic region taken at different times. The sets of sensor measurements include environment geometry data and unaligned trajectory data in local coordinate frames. The georeferenced trajectory estimation system aligns the environment geometry data between sets of sensor measures, and, based on the alignment of the environment geometry data, transforms the identified corresponding trajectory data into a common coordinate frame.
    Type: Grant
    Filed: March 27, 2019
    Date of Patent: May 24, 2022
    Assignee: UATC, LLC
    Inventors: Robert Zlot, Ethan Duff Eade, Peter Hansen, David Prasser, Xxx Xinjilefu
  • Patent number: 11334216
    Abstract: Systems, methods, and non-transitory computer readable media are provided for visually presenting geospatial information. An information request for an area may be received. The area may include one or more predefined regions. The predefined region(s) may be subdivided into one or more levels of predefined sub-regions. Information for the area may be accessed. The information for the area may include region information for the predefined region(s) or sub-region information for the predefined sub-regions. A response to the information request may be determined based on the region information or the sub-region information. The response may enable a visual presentation of (1) the information for the area, and (2) one or more geographical boundaries corresponding to the area.
    Type: Grant
    Filed: October 19, 2017
    Date of Patent: May 17, 2022
    Assignee: Palantir Technologies Inc.
    Inventors: Peter Wilczynski, Andrew Elder, Jeffrey Bagdis, Ryan Zheng
  • Patent number: 11328434
    Abstract: An object tracking device includes a superimposed image creation unit configured to create a plurality of superimposed images in which each of a plurality of non-tracking object images which do not include a tracking object image feature is superimposed on a tracking object section image which includes a tracking object image feature; a discriminator creation unit configured to learn at least one of an image feature and position information of the tracking object, based on the plurality of superimposed images to create a discriminator; and a tracking object specifying unit configured to specify at least one of the image feature and the position information of the tracking object in a tracked image including the respective image features of the tracking object and an obstacle, based on the discriminator and the tracked image.
    Type: Grant
    Filed: March 1, 2018
    Date of Patent: May 10, 2022
    Assignee: UNIVERSITY OF TSUKUBA
    Inventors: Toshiyuki Terunuma, Takeji Sakae
  • Patent number: 11328180
    Abstract: Disclosed are a method for updating a neural network and an electronic device. The method includes: inputting a first image set having tag information into a first depth neural network, and determining a cross entropy loss value of the first image set by using the first depth neural network; inputting a second image set having no tag information separately into the first depth neural network and a second depth neural network, and determining a consistency loss value of the second image set, the first depth neural network and the second depth neural network having the same network structure; updating parameters of the first depth neural network based on the cross entropy loss value and the consistency loss value; and updating parameters of the second depth neural network based on the updated parameters of the first depth neural network.
    Type: Grant
    Filed: October 29, 2019
    Date of Patent: May 10, 2022
    Assignee: Beijing Horizon Robotics Technology Research and Development Co., Ltd.
    Inventors: Yonghao Xu, Qian Zhang, Guoli Wang, Chang Huang
  • Patent number: 11328388
    Abstract: The present technique relates to an image processing apparatus, an image processing method, and a program that can easily execute a stitching process. Provided are: an image generation unit that generates a first reference image regarding a first imaging region on the basis of a plurality of first images regarding the first imaging region and that generates a second reference image regarding a second imaging region at least partially overlapping with the first imaging region on the basis of a plurality of second images regarding the second imaging region; and a processing unit that generates positioning information indicating a correspondence between the first imaging region and the second imaging region on the basis of the first reference image and the second reference image. The present technique can be applied to, for example, an image processing apparatus that executes a stitching process of a plurality of images.
    Type: Grant
    Filed: July 18, 2018
    Date of Patent: May 10, 2022
    Assignee: Sony Group Corporation
    Inventors: Hideo Miyamaki, Masatoshi Takashima, Yu Kitamura, Hiroshi Mori
  • Patent number: 11323586
    Abstract: A reading device includes an emission unit that emits light; a first reflecting unit having a first reflecting surface that reflects the light emitted by the emission unit toward a document; a second reflecting unit having a second reflecting surface that reflects the light reflected by the first reflecting unit and specularly reflected by the document; a first support unit that supports the first reflecting unit and the second reflecting unit and fixes a relative position and a relative orientation between the first reflecting surface and the second reflecting surface; and a second support unit that supports the first support unit such that at least one of a position and an orientation of the first support unit is adjustable.
    Type: Grant
    Filed: December 10, 2020
    Date of Patent: May 3, 2022
    Assignee: FUJIFILM Business Innovation Corp.
    Inventors: Yoji Nishida, Hiroshi Watanabe
  • Patent number: 11316749
    Abstract: In accordance with various embodiments of the present disclosure, topology data, machine performance data, and service performance data of at least one stack of a cloud computing system are received by a cityscape generator. The cityscape generator may then generate a three-dimensional cityscape including at least one neighborhood that represents the at least one stack of the cloud computing system, the at least one neighborhood includes a cluster of first nodes associated with compute resources of a frontend of the at least one stack, a cluster of second nodes associated with compute resources of a backend of the at least one stack, and a cluster of third nodes associated with compute resources of a database cluster of the at least one stack, the generation of the three-dimensional cityscape being based the topology data, the machine performance data, and the service performance data. The cityscape generator may then cause the display of the three-dimensional cityscape.
    Type: Grant
    Filed: October 21, 2020
    Date of Patent: April 26, 2022
    Assignee: Splunk Inc.
    Inventor: Horst Werner
  • Patent number: 11308701
    Abstract: In accordance with an aspect of the present disclosure, there is provided a method for processing image performed by image processing device for rendering an augmented reality image. The method comprises, acquiring a first real image corresponding to a first direction from the image processing device, acquiring a second real image corresponding to a second direction, different from the first direction, from the image processing device, determining reflectivity of a surface of a virtual object in the augmented reality image; and rendering, according to the reflectivity, the surface of the virtual object by using an environment texture, the environment texture generated based on the first real image and the second real image.
    Type: Grant
    Filed: April 30, 2020
    Date of Patent: April 19, 2022
    Assignee: SK TELECOM CO., LTD.
    Inventors: Seungho Shin, Jinsoo Jeon, Gukchan Lim, Ikhwan Cho
  • Patent number: 11291852
    Abstract: Improved targeting of cranial therapy is provided by warping a general purpose brain atlas to a measured head shape of the patient. The resulting patient-specific transformation from brain atlas to patient's head allows one to estimate the location of brain features of the patient without any patient specific brain imaging. Such cost-effective targeting of brain features is especially useful for therapies like transcranial magnetic stimulation, where accuracy of targeting brain structures and session-to-session consistency are both important.
    Type: Grant
    Filed: February 6, 2019
    Date of Patent: April 5, 2022
    Assignee: The Board of Trustees of the Leland Stanford Junior University
    Inventors: Christoph Leuze, Jennifer McNab
  • Patent number: 11287498
    Abstract: In one aspect, in a magnetic resonance imaging system having a gradient coil array comprising a plurality of independent coils distributed about an enclosure, a method of applying currents to said coils is disclosed, which comprises defining a merit function for optimizing at least one feature of any of a magnetic field and an electric field generated by the coils, using a computer processor to optimize the merit function so as to determine an optimal current vector, wherein said element of the current vector provides a current value for application to one of said gradient coils, and applying the currents to said coils.
    Type: Grant
    Filed: May 30, 2019
    Date of Patent: March 29, 2022
    Assignee: Ihsan Dogramaci Bilkent Universiti
    Inventors: Ergin Atalar, Niyazi Koray Ertan, Soheil Taraghinia
  • Patent number: 11284006
    Abstract: Techniques are described for using computing devices to perform automated operations to control acquisition of images in a defined area, including obtaining and using data from one or more hardware sensors on a mobile device that is acquiring the images, analyzing the sensor data (e.g., in a real-time manner) to determine the geometric orientation of the mobile device in three-dimensional (3D) space, and using that determined orientation to control the acquisition of further images by the mobile device. In some situations, the determined orientation information may be used in part to automatically generate and display a corresponding GUI (graphical user interface) that is overlaid on and augments displayed images of the environment surrounding the mobile device during the image acquisition process, so as to control the mobile device's geometric orientation in 3D space.
    Type: Grant
    Filed: October 28, 2020
    Date of Patent: March 22, 2022
    Assignee: Zillow, Inc.
    Inventors: Mitchell David Dawson, Li Guan, Andrew H. Otwell, Dun-Yu Hsiao
  • Patent number: 11282280
    Abstract: The present invention relates to a method for vectorising nodes within a plurality of 360 degree images. The method includes identifying a set of points of interest within a first 360 degree image of the plurality of 360 degree images; identifying a corresponding set of points of interest within a second 360 degree image of the plurality of 360 degree images; and calculating the 3D coordinates of the points of interest using triangulation of both sets of points of interest. A system and software are also disclosed.
    Type: Grant
    Filed: July 8, 2018
    Date of Patent: March 22, 2022
    Assignee: TIME2MARKET SA
    Inventors: Gérard Philibert Crittin, Camille Cottagnoud, Matthieu Claude Léon Garrigues, Lionel Robert Daniel Crassier
  • Patent number: 11257195
    Abstract: The present principles relates to a method and device for reconstructing an HDR image by applying a reconstruction process on a SDR image whose the content is similar to the content of the HDR image but the dynamic range of the luminance values of said SDR image is lower than the dynamic range of the luminance values of said HDR image, said reconstruction process requiring parameters obtained from a bitstream. The method is characterized in that the method further comprises determining whether all the required parameters are available from the bitstream and recovering the lost or corrupted parameters from additional data, said reconstruction process further taking into account said recovered parameters.
    Type: Grant
    Filed: February 19, 2018
    Date of Patent: February 22, 2022
    Assignee: INTERDIGITAL VC HOLDINGS, INC.
    Inventors: Pierre Andrivon, Edouard Francois, Yannick Olivier, David Touze
  • Patent number: 11258925
    Abstract: An information processing apparatus includes a receiver that receives an input image to be recognized and a processor configured to, by executing a program, align the input image with a template image in such a way as to match a recognition area of the input image and a recognition area defined on the template image, perform a process for recognizing the recognition area of the aligned input image, generate a check image including the template image and the aligned input image, and display the check image and a result of the process for recognizing the recognition area of the aligned input image such that a correspondence between the check image and the result is recognizable.
    Type: Grant
    Filed: August 26, 2020
    Date of Patent: February 22, 2022
    Assignee: FUJIFILM Business Innovation Corp.
    Inventors: Shunichi Kimura, Masanori Sekino
  • Patent number: 11210862
    Abstract: A computing device spatially reconstructs a virtual feature surface in a mixed reality environment. The computing device detects addition of a raycast element to a virtual user space, maps multiple feature points detected from multiple video frames of a physical user space into a virtual user space, selecting at least three feature points from the multiple feature points that satisfy selection criteria applied in the virtual user space along a raycast axis of the raycast element in the virtual user space, and defines the virtual feature surface in the virtual user space using the at least three selected feature points. At least two of the at least three feature points are detected in different video frames.
    Type: Grant
    Filed: June 25, 2020
    Date of Patent: December 28, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Jacek Ciereszko, Gregory Bishop Bahm, Cedric Khanntipo Ith, Xonatia Ravelle Lee
  • Patent number: 11207042
    Abstract: The present invention relates to vascular treatment outcome visualization. To provide an enhanced possibility to check that a vascular treatment has been correctly performed, it is proposed to provide (112) a first image data (114) of a region of interest of a vascular structure at a first point in time, and to provide (116) at least one second image data (118) of the region of interest of the vascular structure at a second point in time, wherein a vascular treatment has been applied to the vascular structure between the first point in time and the second point in time. Further, the first and the at least one second image data are combined (120) generating a joint outcome visualization image data (122) and the joint outcome visualization image data is displayed (124).
    Type: Grant
    Filed: August 24, 2012
    Date of Patent: December 28, 2021
    Assignee: KONINKLIJKE PHILIPS N.V.
    Inventors: Vincent Maurice Andre Auvray, Raoul Florent
  • Patent number: 11209548
    Abstract: Embodiments relate to methods for efficiently encoding sensor data captured by an autonomous vehicle and building a high definition map using the encoded sensor data. The sensor data can be LiDAR data which is expressed as multiple image representations. Image representations that include important LiDAR data undergo a lossless compression while image representations that include LiDAR data that is more error-tolerant undergo a lossy compression. Therefore, the compressed sensor data can be transmitted to an online system for building a high definition map. When building a high definition map, entities, such as road signs and road lines, are constructed such that when encoded and compressed, the high definition map consumes less storage space. The positions of entities are expressed in relation to a reference centerline in the high definition map. Therefore, each position of an entity can be expressed in fewer numerical digits in comparison to conventional methods.
    Type: Grant
    Filed: July 29, 2019
    Date of Patent: December 28, 2021
    Assignee: NVIDIA CORPORATION
    Inventors: Lin Yang, Mark Damon Wheeler
  • Patent number: 11195303
    Abstract: A method for characterizing a pose estimation system includes: receiving, from a pose estimation system, first poses of an arrangement of objects in a first scene; receiving, from the pose estimation system, second poses of the arrangement of objects in a second scene, the second scene being a rigid transformation of the arrangement of objects of the first scene with respect to the pose estimation system; computing a coarse scene transformation between the first scene and the second scene; matching corresponding poses between the first poses and the second poses; computing a refined scene transformation between the first scene and the second scene based on coarse scene transformation, the first poses, and the second poses; transforming the first poses based on the refined scene transformation to compute transformed first poses; and computing an average rotation error and an average translation error of the pose estimation system based on differences between the transformed first poses and the second poses.
    Type: Grant
    Filed: December 3, 2020
    Date of Patent: December 7, 2021
    Assignee: BOSTON POLARIMETRICS, INC.
    Inventors: Agastya Kalra, Achuta Kadambi, Kartik Venkataraman
  • Patent number: 11182043
    Abstract: A system for display and interaction includes an interface and a processor. The interface is configured to receive data from one or more sensors. The processor is configured to convert the data to a common synthetic data space; provide the common synthetic data space for display; and receive a command associated with an object represented in the common synthetic data space. In some embodiments, the processor is coupled to a memory that stores instructions for the processor.
    Type: Grant
    Filed: November 27, 2018
    Date of Patent: November 23, 2021
    Assignee: Anduril Industries Inc.
    Inventors: Palmer F. Luckey, Jason Levin, Julian Hammerstein, Joseph Chen, Maximillian Zheng Wang
  • Patent number: 11172218
    Abstract: A motion estimation method includes calculating a global camera motion vector for a region of an image frame, calculating a global estimated motion vector for the region of the image frame, and determining a global motion vector for the region based on the global camera motion vector and the global estimated motion vector.
    Type: Grant
    Filed: September 10, 2020
    Date of Patent: November 9, 2021
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventor: Lei Zhu
  • Patent number: 11158069
    Abstract: In order to reduce computation time and provide more accurate solutions for bi-directional, multi-modal image registration, a learning-based unsupervised multi-modal deformable image registration method that does not require any aligned image pairs or anatomical landmarks is provided. A bi-directional registration function is learned based on disentangled shape representation by optimizing a similarity criterion defined on both latent space and image space.
    Type: Grant
    Filed: May 31, 2019
    Date of Patent: October 26, 2021
    Assignee: Siemens Healthcare GmbH
    Inventors: Bibo Shi, Chen Qin, Rui Liao, Tommaso Mansi, Ali Kamen
  • Patent number: 11138410
    Abstract: A system and method for recognizing objects in an image is described. The system can receive an image from a sensor and detect one or more objects in the image. The system can further detect one or more components of each detected object. Subsequently, the system can create a segmentation map based on the components detected for each detected object and determine whether the segmentation map matches a plurality of 3-D models (or projections thereof). Additionally, the system can display a notification through a user interface indicating whether the segmentation map matches at least one of the plurality of 3-D models.
    Type: Grant
    Filed: August 25, 2020
    Date of Patent: October 5, 2021
    Assignee: Covar Applied Technologies, Inc.
    Inventors: Peter A. Torrione, Mark Hibbard
  • Patent number: 11120576
    Abstract: A method and system for calibration parameter validation. The method includes performing a camera calibration generating a calibration result, applying a coarse pass-fail criteria to the calibration result and rejecting the camera if the calibration result does not pass the coarse pass fail-criteria. The method further includes applying a fine pass-fail criteria based upon at least information stored at a central repository to the calibration result if the calibration result passes the coarse pass-fail criteria, rejecting the camera if the calibration result does not pass the fine pass fail-criteria, accepting the camera if the calibration result passes the fine pass fail-criteria, and entering the calibration result into the central repository. The information stored at the central repository includes key performance indicator/key performance metric information for one or more measured parameters of the calibration result.
    Type: Grant
    Filed: March 29, 2020
    Date of Patent: September 14, 2021
    Assignee: Edge 3 Technologies, Inc.
    Inventors: Tarek El Dokor, Jordan Cluster, Milind Subhash Gide
  • Patent number: 11094112
    Abstract: The present invention generally relates to generating a three-dimensional representation of a physical environment, which includes dynamic scenarios.
    Type: Grant
    Filed: August 15, 2019
    Date of Patent: August 17, 2021
    Assignee: Foresight AI Inc.
    Inventors: Shili Xu, Matheen Siddiqui, Chang Yuan
  • Patent number: 11087438
    Abstract: A driver assistance system and a method for merging partial images to form an image of a contiguous surrounding region of a mode of transport are provided. The method includes the following steps: detecting a first partial region of the surrounding region by a first environmental sensor; detecting a second partial region of the surrounding region by a second environmental sensor; generating a first partial image of the first partial region on the basis of a signal from the first environmental sensor; generating a second partial image of the second partial region on the basis of a signal of the second environmental sensor and a multiplicity of virtual sensors for detecting the second partial region; and merging the first partial image and the second partial image along a straight first joining line, wherein the virtual sensors are arranged at positions substantially on a perpendicular to the joining line.
    Type: Grant
    Filed: January 10, 2017
    Date of Patent: August 10, 2021
    Assignee: Bayerische Motoren Werke Aktiengesellschaft
    Inventors: Torsten Schmidt, Philipp Hoffmann
  • Patent number: 11069439
    Abstract: A method for controlling an evaluation system for medical images of a patient is proposed. Medical images of the patient acquired at different time points are stored in an image database. Upon reception of a user command associated with a time-dependent evaluation command including at least one evaluation parameter describing an evaluation to be performed and identification information describing the patient, medical images of the patient fulfilling a relevancy criterion depending on the evaluation parameter and acquired at different time points are retrieved from the image database. The retrieved images are registered to each other in at least one registration process. Finally, a composite evaluation image data set including a time series of evaluation images is derived from the registered retrieved images and output to the user.
    Type: Grant
    Filed: November 27, 2018
    Date of Patent: July 20, 2021
    Assignee: SIEMENS HEALTHCARE GMBH
    Inventors: Bjoern Heismann, Razvan Ionasec
  • Patent number: 11055819
    Abstract: Techniques for machine learning-based image super-resolution are described. A Dual Path Deep Back Projection Network can be used to enhance an input image. For example, the model may be trained to perform image super-resolution, remove artifacts, provide filtering or low light enhancement, etc. Classification may be performed on the resulting enhanced images to identify objects represented in the images. The model may be trained using a dataset that includes groups of images: an original image and an enhanced image. The model may use both residual and dense connectivity patterns between each successive back projection blocks to improve construction of a high-resolution output image from a low resolution input image. The enhanced images increase classification accuracy for input images having low image resolution.
    Type: Grant
    Filed: September 27, 2018
    Date of Patent: July 6, 2021
    Assignee: Amazon Technologies, Inc.
    Inventors: Kunwar Yashraj Singh, Paulo Mendonca
  • Patent number: 11049238
    Abstract: Systems and methods for using quantitative ultrasound (“QUS”) techniques to generate imaging biomarkers that can be used to assess a prediction of tumor response to different chemotherapy treatment regimens are provided. For instance, the imaging biomarkers can be used to subtype tumors that have resistance to certain chemotherapy regimens prior to drug exposure. These imaging biomarkers can therefore be useful for predicting tumor response and for assessing the prognostic value of particular treatment regimens.
    Type: Grant
    Filed: June 21, 2016
    Date of Patent: June 29, 2021
    Assignee: SUNNYBROOK RESEARCH INSTITUTE
    Inventors: Hadi Tadayyon, Gregory J. Czarnota, Ali Sadeghi-Naini, Mehrdad Gangeh, Lakshmanan Sannachi, William Tyler Tran
  • Patent number: 11023993
    Abstract: The present application relates to an apparatus for verifying fragment processing related data and a method of operating thereof. The fragment shader unit is coupled to the at least one data buffer. A fragment shader unit of a graphics processing pipeline receives fragment data and records fragment processing related data in the at least one data buffer on processing one or more fragments in accordance with the received fragment data. A comparator unit coupled to the at least one data buffer compares the recorded fragment processing related data in the at least one data buffer to reference data and issues a fault indication signal in case the recorded fragment processing related data and the reference data mismatch.
    Type: Grant
    Filed: June 23, 2015
    Date of Patent: June 1, 2021
    Assignee: NXP USA, Inc.
    Inventors: Robert Cristian Krutsch, Oliver Bibel, Rolf Dieter Schlagenhaft, Dirk Wendel
  • Patent number: 11017264
    Abstract: A neural network apparatus includes one or more processors configured to acquire an input feature map and trained weights, generate a plurality of sub-feature maps by splitting the input feature map based on a dilation rate, generate a plurality of intermediate feature maps by performing a convolution operation between the plurality of sub-feature maps and the trained weights, and generate a dilated output feature map by merging the plurality of intermediate feature maps based on the dilation rate.
    Type: Grant
    Filed: April 24, 2019
    Date of Patent: May 25, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventor: Junwoo Jang
  • Patent number: 10997455
    Abstract: Disclosed is an apparatus and method of correcting 3D image distortion. A method of correcting 3D image distortion according to the present disclosure includes: receiving an input image that contains a predetermined first pattern; extracting a characteristic value related to the first pattern from the input image; and updating the input image on the basis of the extracted characteristic value.
    Type: Grant
    Filed: April 15, 2019
    Date of Patent: May 4, 2021
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Joon Soo Kim, Gwang Soon Lee
  • Patent number: 10970831
    Abstract: Systems, methods, and computer-readable media for feedback on and improving the accuracy of super-resolution imaging. In some embodiments, a low resolution image of a specimen can be obtained using a low resolution objective of a microscopy inspection system. A super-resolution image of at least a portion of the specimen can be generated from the low resolution image of the specimen using a super-resolution image simulation. Subsequently, an accuracy assessment of the super-resolution image can be identified based on one or more degrees of equivalence between the super-resolution image and one or more actually scanned high resolution images of at least a portion of one or more related specimens identified using a simulated image classifier. Based on the accuracy assessment of the super-resolution image, it can be determined whether to further process the super-resolution image. The super-resolution image can be further processed if it is determined to further process the super-resolution image.
    Type: Grant
    Filed: September 23, 2020
    Date of Patent: April 6, 2021
    Assignee: Nanotronics Imaging, Inc.
    Inventors: Matthew C. Putman, John B. Putman, Vadim Pinskiy, Joseph Succar
  • Patent number: 10970597
    Abstract: An approach is provided for priority ranking of satellite images. The approach, for example, involves processing a plurality of images using a feature detector to determine a set of features on each image of the plurality of images. The approach also involves determining a count of feature correspondences between each pair of images of the plurality of images based on the set of features of said each image. The approach further involves computing a ranking of the plurality of images based on the count of features correspondences between said each pair of images. The approach further involves providing the ranking of the plurality of images as an output for selecting one or more images of the plurality of images for feature creation.
    Type: Grant
    Filed: May 22, 2019
    Date of Patent: April 6, 2021
    Assignee: HERE GLOBAL B.V.
    Inventors: David Johnston Lawlor, Anish Mittal, Zhanwei Chen
  • Patent number: 10964021
    Abstract: An information processing apparatus includes a first selection unit that selects a second image to be compared with a first image from a plurality of candidate images, a setting unit, an overlap range calculation unit, an evaluation value calculation unit, and a second selection unit. The setting unit sets a plurality of combinations including two or more candidate images from among the plurality of candidate images. The overlap range calculation unit calculates an overlap range between the first image and each of the plurality of combinations. The evaluation value calculation unit calculates an evaluation value of each of the plurality of combinations based on the calculated overlap range. The second selection unit selects at least one combination from the plurality of combinations based on the evaluation value. The first selection unit selects the two or more candidate images included in the selected combination as the second image.
    Type: Grant
    Filed: January 28, 2019
    Date of Patent: March 30, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Gakuto Aoyama, Ryo Ishikawa
  • Patent number: 10943149
    Abstract: Methods and systems for automatic estimation of object characteristics from a digital image are disclosed, including a method comprising sub-dividing into two or more segments a digital image comprising pixels and depicting an object of interest, wherein each segment comprises two or more pixels; assessing content depicted in one or more of the segments for a predetermined object characteristic using machine learning techniques comprising General Image Classification of the one or more segments using a convolutional neural network, wherein the General Image Classification comprises analyzing the segment as a whole and outputting a general classification for the segment as a whole as related to the one or more predetermined object characteristic; and determining a level of confidence of one or more of the segments having the one or more predetermined object characteristic based on the General Image Classification assessment.
    Type: Grant
    Filed: August 30, 2018
    Date of Patent: March 9, 2021
    Assignee: OMNIEARTH, INC.
    Inventors: Shadrian Strong, David Murr, Lars P. Dyrud
  • Patent number: 10908678
    Abstract: Techniques are disclosed for systems and methods for providing a fused image that combines image data of a scene received from an imaging system with a chart to aid in the navigation of a mobile structure. Specifically, the fused image may be generated by superimposing various image elements extracted from an image onto various locations on the chart that correlate to the actual positions of the objects within the scene. In some embodiments, one or more non-water objects may be detected within the image, image representations of the non-water objects may be extracted from the image feed, and the extracted image representations may be superimposed onto locations on the chart that are determined to correlate to the actual positions of the non-water objects within the scene.
    Type: Grant
    Filed: October 25, 2019
    Date of Patent: February 2, 2021
    Assignee: FLIR Belgium BVBA
    Inventors: Mark Johnson, Richard Jales, Dorian Le Coz
  • Patent number: 10902656
    Abstract: A system and method for generating a digital image collage is provided. The method comprises displaying a user interface comprising a collage template including a layout, and a catalog segment; displaying a plurality of digital images in the catalog segment; generating a first aperture in the layout to establish a first arrangement, and populating the first aperture with the first selected digital image; changing the layout from the first arrangement to a second arrangement, wherein the second arrangement comprises randomly dividing the first aperture into a second aperture and a third aperture, populating the second aperture with the first selected digital image, and populating the third aperture with the second selected digital image thereby generating the digital image collage.
    Type: Grant
    Filed: February 28, 2017
    Date of Patent: January 26, 2021
    Assignee: FUJIFILM North America Corporation
    Inventors: William A. Fuss, Nathaniel P. Curry, Christopher T Asbury
  • Patent number: 10823851
    Abstract: A device for estimating a degree of freedom for movement includes a memory, and a processor coupled to the memory and the processor configured to acquire first three-dimensional information of a target object at a first time and second three-dimensional information of the target object at a second time, specify a movable portion of the target object according to a difference between the first three-dimensional information and the second three-dimensional information, estimate the degree of freedom for movement of the movable portion included in the target object according to displacement of the movable portion between the first three-dimensional information and the second three-dimensional information, and assign degree of freedom information for indicating the degree of freedom for movement to a three-dimensional model for representing the target object, based on the estimated degree of freedom for movement of the movable portion.
    Type: Grant
    Filed: January 7, 2019
    Date of Patent: November 3, 2020
    Assignee: FUJITSU LIMITED
    Inventor: Moyuru Yamada
  • Patent number: 10796421
    Abstract: Embodiments of the present invention are directed to facilitating images with selective application of the long-exposure effect. In accordance with some embodiments of the present invention, virtual long-exposure image comprising a plurality of aligned frames is provided and a selection of a region of pixels in the virtual long-exposure image is received. The virtual long-exposure image is combined with one of the frames forming the virtual long-exposure image to create a selective virtual long-exposure image. The selective virtual long-exposure image comprises a visible portion of the original virtual long-exposure image and a visible portion of the individual frame that corresponds to the selected region of pixels. Additional frames may be combined with the virtual long-exposure image to create a plurality of selective virtual long-exposure image options, and the user may select one for continued use or for saving.
    Type: Grant
    Filed: February 13, 2018
    Date of Patent: October 6, 2020
    Inventors: Seyed Morteza Safdarnejad, Sarah Aye Kong, Gregg Darryl Wilensky, Chih-Yao Hsieh