Reading Maps, Graphs, Drawings, Or Schematics Patents (Class 382/113)
  • Patent number: 11954838
    Abstract: The present invention relates to the curation of map data. More particularly, the present invention relates to a method for preparing map data to present to a data curator for substantially optimal quality assurance. Further, the present invention relates to a tool for a data curator to verify map data. According to a first aspect, there is provided a method comprising: generating a plurality of interdependent map portions from a global map; determining, from the plurality of interdependent map portions, at least one interdependent map portion that requires validation; creating at least one group of interdependent map portions, the group of interdependent map portions comprising: the determined at least one interdependent map portion that requires validation; and at least one additional interdependent map portion; and outputting the at least one group of interdependent map portions for validation.
    Type: Grant
    Filed: December 31, 2019
    Date of Patent: April 9, 2024
    Assignee: Lyft, Inc.
    Inventors: Matej Hamas, Luca Del Pero, Yerzhan Utkelbayev
  • Patent number: 11940291
    Abstract: A method for updating a map of the surrounding area wherein the map is used when controlling a transportation vehicle. The transportation vehicle attempts, when travelling along a carriageway, to detect a landmark recorded in the map of the surrounding area using sensors. In response to the transportation vehicle being unable to detect the landmark using its sensors, the transportation vehicle prepares a proposal for deletion which is sent to an external central computer. The proposal for deletion is examined in the external central computer and deletes the landmark from the map of the surrounding area in response to the proposal for deletion being verified. In the method, information regarding a visibility range for the landmark is entered in the map of the surrounding area specifying at what range the landmark is visible from a road permitting a more effective detection of landmarks.
    Type: Grant
    Filed: July 25, 2019
    Date of Patent: March 26, 2024
    Assignee: VOLKSWAGEN AKTIENGESELLSCHAFT
    Inventors: Daniel Wilbers, Christian Merfels, Bernd Rech, Thilo Schaper, Niklas Koch, Stefan Jürgens, David Perdomo Lopez, Constanze Hungar
  • Patent number: 11933612
    Abstract: The invention relates to computer-implemented method for the 3D reconstruction of a ground surface area by stereophotogrammetry, comprising the steps of: determining corrected Rational Polynomial Camera, RPC, models by performing bundle adjustment (BA) of original RPC models each provided with an image of a set of images of the ground surface area acquired by a remote imaging sensor and each associated to a corresponding original projection function ({Pm}) from a 3D object space to a 2D image space, wherein determining the corrected RPC models comprises determining corrected projection functions ({Pmcor}) from the 3D object space to the 2D image space; and determining (PC) a 3D point cloud representative (3DPC) of the ground surface area by triangulation, based on the corrected RPC models, of stereo correspondences within images of the set of images.
    Type: Grant
    Filed: July 21, 2021
    Date of Patent: March 19, 2024
    Assignee: Kayrros
    Inventors: Roger Mari, Gabriele Facciolo, Jérémy Anger, Carlo De Franchis
  • Patent number: 11922000
    Abstract: Aspects of the subject disclosure may include, for example, a method including generating a plurality of discrete polygons from a digital image of a location, modifying a boundary of a first discrete polygon of the plurality of discrete polygons based on a user input at a venue map graphical user interface, assigning, at the venue map graphical user interface, a first zone of a plurality of zones associated with a first venue of a plurality of venues to a second discrete polygon of the plurality of discrete polygons, and presenting a performance map graphical user interface for the first venue of the plurality of venues including the second discrete polygon of the plurality of discrete polygons overlaid onto the digital image of the location. Other embodiments are disclosed.
    Type: Grant
    Filed: March 29, 2022
    Date of Patent: March 5, 2024
    Assignee: AT&T Mobility II LLC
    Inventors: Jason Young, Muhammed Abughrara
  • Patent number: 11922651
    Abstract: A device may receive a first image. The device may process the first image to identify an object in the first image and a location of the object within the first image. The device may extract a second image from the first image based on the location of the object within the first image. The device may process the second image to determine at least one of a coarse-grained viewpoint estimate or a fine-grained viewpoint estimate associated with the object. The device may determine an object viewpoint associated with the second vehicle based on the at least one of the coarse-grained viewpoint estimate or the fine-grained viewpoint estimate. The device may perform one or more actions based on the object viewpoint.
    Type: Grant
    Filed: December 2, 2022
    Date of Patent: March 5, 2024
    Assignee: Verizon Connect Development Limited
    Inventors: Simone Magistri, Francesco Sambo, Douglas Coimbra De Andrade, Fabio Schoen, Matteo Simoncini, Luca Bravi, Stefano Caprasecca, Luca Kubin, Leonardo Taccari
  • Patent number: 11893685
    Abstract: The present disclosure provides a landform map building method and apparatus, an electronic device and a readable storage medium, and relates to the field of image processing technologies.
    Type: Grant
    Filed: November 17, 2021
    Date of Patent: February 6, 2024
    Assignee: BEIJING BAIDU NETCOM SCIENCE TECHNOLOGY CO., LTD.
    Inventors: Junjun Zhang, Yi Zeng, Xiaopei Hou
  • Patent number: 11854257
    Abstract: Methods, apparatus and computer program for identifying canopy structures are provided. In one aspect, a method includes receiving a first calculated offset between a start point of a shadow cast by a building and a proximate first vertex of a building footprint of the building, and receiving a second calculated offset between an end point of the shadow cast by the building and a proximate second vertex of the building footprint, the shadow identified from an overhead image of the building, and wherein the building footprint comprises a shadowed side and a non-shadowed side, each running between the start point and the end point of the shadow on a different respective side of the building. The method also includes comparing the offsets to an offset threshold, and in response to both the first and second received offsets exceeding the offset threshold, determining that the building footprint represents a canopy.
    Type: Grant
    Filed: May 18, 2021
    Date of Patent: December 26, 2023
    Assignee: HERE GLOBAL B.V.
    Inventor: Priyank Sameer
  • Patent number: 11846510
    Abstract: A system is disclosed including at least one memory including computer program instructions, which when executed by at least one processor, cause the system to at least generate, based on a plurality of images from a camera, a first map including a first plurality of features; generate, based on data from a light ranging sensor, a second map including a second plurality of features; and determine, based on a comparison of the first plurality of features and the second plurality of features, a position of the first map relative to the second map. A corresponding method and non-transitory computer-readable medium are also provided.
    Type: Grant
    Filed: September 16, 2021
    Date of Patent: December 19, 2023
    Assignee: TUSIMPLE, INC.
    Inventors: Yi Luo, Yi Wang, Ke Xu
  • Patent number: 11790628
    Abstract: An apparatus for generating a map identifies a lane line and a feature other than a lane line on a road from a first image of a predetermined location of the road taken downward from the sky; identifies the lane line and the feature from a second image representing the predetermined location of the road and made based on images taken by a camera provided for a vehicle; aligning the first images with the second images, based on the predetermined location; deforms the second image so that the feature in the second image best fits the feature in the first image; further deforms the second image in a direction perpendicular to the front-back direction of the road so that the position of the feature remains unchanged and that the positions of the lane lines in the first and second images match; and combines the first and deformed second images.
    Type: Grant
    Filed: August 19, 2021
    Date of Patent: October 17, 2023
    Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHA
    Inventor: Masahiro Tanaka
  • Patent number: 11763568
    Abstract: Estimation of the ground plane of a three dimensional (3D) point cloud based modifications to the random sample consensus (RANSAC) algorithm is provided. The modifications may include applying roll and pitch constraints to the selection of random planes in the 3D point cloud, using a cost function based on the number of inliers in the random plane and the number of 3D points below the random plane in the 3D point cloud, and computing a distance threshold for the 3D point cloud that is used in determining whether or not a 3D point in the 3D point cloud is an inlier of a random plane.
    Type: Grant
    Filed: December 8, 2020
    Date of Patent: September 19, 2023
    Assignee: Texas Instruments Incorporated
    Inventors: Soyeb Nagori, Poorna Kumar, Manu Mathew, Prashanth Ramanathpur Viswanath, Deepak Kumar Poddar
  • Patent number: 11725959
    Abstract: In various examples, a gaze direction of a user's eyes may be tracked and synced with perception data of the vehicle to determine POIs that the user is interested in. In some examples, POIs may be stored as waypoints in a waypoint catalog or store and included as part of a map. As a user is driving in a vehicle down a roadway, a system onboard the vehicle may access the map to determine locations of the vehicle, and may reference the waypoint catalog to determine the POIs that the vehicle passes. Using an advertiser name, contact information, an advertisement image, advertiser website information, links to additional content, etc. relating to each waypoint, a log of the passed POIs may be stored for access by the user.
    Type: Grant
    Filed: November 13, 2020
    Date of Patent: August 15, 2023
    Assignee: NVIDIA Corporation
    Inventor: Andrew Fear
  • Patent number: 11722646
    Abstract: A computer-implemented method and system is disclosed for capturing and distributing aerial images and/or videos. Images and/or videos are captured from aircraft and transmitted to a ground station. Users are able to view captured images on a real-time or near real-time basis through a user platform on mobile devices and web browsers. The location of the user may also be determined and used to interpolate the user's location with the captured images.
    Type: Grant
    Filed: July 31, 2020
    Date of Patent: August 8, 2023
    Assignee: METROPOLITAN LIFE INSURANCE CO.
    Inventor: Richard Hong
  • Patent number: 11693414
    Abstract: An autonomous navigation system may navigate through an environment in which one or more non-solid objects, including gaseous and/or liquid objects, are located. Non-solid objects may be determined, using sensor data, to present an obstacle or interference based on determined chemical composition, size, position, velocity, concentration, etc. of the objects.
    Type: Grant
    Filed: February 28, 2022
    Date of Patent: July 4, 2023
    Assignee: Apple Inc.
    Inventors: Byron B. Han, Young Woo Seo, Kit-Man Wan
  • Patent number: 11647276
    Abstract: A portable information device including a body, a position information portion that is provided in the body and that outputs position information, an image sensor that is provided in the body, a display system that is provided in the body and that displays, on a local field in a screen field, relevant information based on the position information such that the displayed relevant information is overlapped on a real-time image, an input portion that is provided on the body and, by use of which user operates an icon, the icon being displayed on the local field such that the displayed icon is overlapped on the real-time image and an imaging button that is provided, separately from the input portion, on the body and that is operated by user to capture a subject image via the image sensor.
    Type: Grant
    Filed: August 5, 2022
    Date of Patent: May 9, 2023
    Assignee: NIKON CORPORATION
    Inventors: Hideya Inoue, Toru Iwaoka, Michiko Noborisaka, Masayuki Hatori, Tomohide Hamada
  • Patent number: 11625843
    Abstract: Systems and methods are disclosed for automatically aligning drawings. One method comprises receiving a source drawing and a target drawing, determining main axes of the source and target drawings respectively, and aligning the main axis of the source drawing to the main axis of the target drawing. A plurality of source feature point vectors and target feature point vectors may be generated from the source and target drawings, whose main axes have been aligned. A predetermined number of matching FPV pairs may then be determined across the source and target drawings, and the source drawing may be aligned with the target drawings based on the matching FPV pairs.
    Type: Grant
    Filed: June 24, 2020
    Date of Patent: April 11, 2023
    Assignee: Bluebeam, Inc.
    Inventors: Jae Min Lee, Joseph W. Wezorek
  • Patent number: 11625914
    Abstract: Systems, devices, media and methods are presented for identifying key terrain areas in a geographic location by accessing an image comprising a view of the geographic location comprising a plurality of terrain areas and for each terrain area, assigning a first score corresponding to positive or negative key terrain determinations using a general rule, assigning a second score corresponding to positive or negative key terrain determinations using an override rule, assigning a third score corresponding to positive or negative key terrain determinations using a user-defined rule and generating an aggregate mask to assign the key terrain area with an aggregate score. Based on the aggregate score, key terrain areas are identified and displayed on a computing device.
    Type: Grant
    Filed: October 6, 2020
    Date of Patent: April 11, 2023
    Assignee: Raytheon Company
    Inventor: Sarah A. Crate
  • Patent number: 11625868
    Abstract: A centerline for generating network data of an indoor space can be generated while limiting the amount of calculation. Points where first straight lines and second straight lines constituting centerlines meet are created using re-entrant vertices (Step 1). The points created in Step 1 are connected by lines (Step 2). Connection lines corresponding to the longest sides are repeatedly deleted from closed polygons defined by the connection lines obtained in Step 2 until no closed polygons are left (Step 3). Each vertex of the connection lines obtained in Step 3 is connected to a farthest center point on the perimeter of the shape of the passage if there is such a farthest center point to which the vertex can be connected without touching the perimeter and without crossing other connection lines (Step 4).
    Type: Grant
    Filed: October 18, 2019
    Date of Patent: April 11, 2023
    Assignee: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
    Inventors: Mitsuru Mochizuki, Kyota Tsutsumida, Osamu Matsuda, Hitoshi Seshimo
  • Patent number: 11625553
    Abstract: Some embodiments relate to generating three dimensional virtual representations of a building construction structure based on two-dimensional real-world construction plans, such as architectural plans or building plans. Some embodiments further produce autonomous, near real-time, and highly accurate and comprehensive building take-offs, complete construction detailing or estimates, detailed bill of materials, plan analysis (including detection of a number of non-standardized objects, such as doors or windows), as well as transforming 2D drawings into 3D and/or providing Building Information Modeling (BIM).
    Type: Grant
    Filed: September 10, 2021
    Date of Patent: April 11, 2023
    Assignee: Buildingestimates.Com Limited
    Inventors: Benjamin John Powles, Stephen James Thomas, Shaveer Rajan Mirpuri
  • Patent number: 11601635
    Abstract: A stereoscopic vision system captures stereoscopic images. The stereoscopic images are processed to rapidly discriminate between portions of the images that are on a ground-plane and those that are off the ground plane. The discrimination is based on comparing locations within the images using an expected disparity shift.
    Type: Grant
    Filed: December 7, 2021
    Date of Patent: March 7, 2023
    Assignee: BlackBerry Limited
    Inventor: Gordon Bell
  • Patent number: 11587310
    Abstract: Disclosed herein are systems, media, and methods for identifying and assessing topographical features such as vegetation density and surface water using satellite data, comprising: a digital processing device; a database of digital maps, each indicative of grazing area(s); and a computer program to create an application comprising: a software module receiving a first set of satellite data indicative of a first topographical feature of the land; a software module calculating a normalized index array of the first topographic feature for the time period using the first set of satellite data; a software module generating a custom map indicative of density of the first topographical feature; a software module combining the custom map with one of the digital maps to generate a combined map indicative of the density of the first topographical feature within the grazing areas; and a software module allowing a user to visualize or print the combined map.
    Type: Grant
    Filed: September 12, 2018
    Date of Patent: February 21, 2023
    Assignee: PROJECT CONCERN INTERNATIONAL
    Inventors: Christopher Bessenecker, Jennifer Waugaman, Peter Hoefsloote
  • Patent number: 11574084
    Abstract: A method for geometric analysis of a part for manufacture, the method including receiving, by a processor, a computer model of a part for manufacture; receiving, by the processor, a print of the part for manufacture; extracting, by the processor, a semantic datum from the print of the part for manufacture; mapping, by the processor, the semantic datum on the computer model of the part for manufacture; and generating, by the processor, a manufacturing instruction based on the semantic datum mapped on the computer model of the part for manufacture.
    Type: Grant
    Filed: January 31, 2022
    Date of Patent: February 7, 2023
    Assignee: PROTOLABS, INC.
    Inventors: Troy David Marusich, Shuji Usui
  • Patent number: 11562830
    Abstract: A merchant evaluation method includes: acquiring multi-dimensional evaluation index data of a merchant to be evaluated; for the multi-dimensional evaluation index data, obtaining, by calculation based on standard normal distribution, a health portrait of the merchant to be evaluated, and obtaining, by calculation based on a geometric mean, a health score of the merchant to be evaluated, wherein the health portrait is data representing at least one evaluation result of the merchant to be evaluated; and outputting the health portrait and the health score of the merchant to be evaluated.
    Type: Grant
    Filed: October 23, 2019
    Date of Patent: January 24, 2023
    Assignee: Advanced New Technologies Co., Ltd.
    Inventors: Lin Zheng, Jiang Zhu, Jie Li, Tao Chen, Tianyi Zhang
  • Patent number: 11532096
    Abstract: A device may receive a first image. The device may process the first image to identify an object in the first image and a location of the object within the first image. The device may extract a second image from the first image based on the location of the object within the first image. The device may process the second image to determine at least one of a coarse-grained viewpoint estimate or a fine-grained viewpoint estimate associated with the object. The device may determine an object viewpoint associated with the second vehicle based on the at least one of the coarse-grained viewpoint estimate or the fine-grained viewpoint estimate. The device may perform one or more actions based on the object viewpoint.
    Type: Grant
    Filed: August 24, 2020
    Date of Patent: December 20, 2022
    Assignee: Verizon Connect Development Limited
    Inventors: Simone Magistri, Francesco Sambo, Douglas Coimbra de Andrade, Fabio Schoen, Matteo Simoncini, Luca Bravi, Stefano Caprasecca, Luca Kubin, Leonardo Taccari
  • Patent number: 11500913
    Abstract: A determination device 1 includes: a history storage unit 101 configured to accumulate and store use history information in which application identification information, position information indicating a position of a user, and user identification information are correlated with each other; a use region UU number totaling unit 105 configured to total a UU number for each of a plurality of regions on the basis of the use history information for a specific application; a use region number totaling unit 106 configured to total the number of regions on the basis of the use history information for the specific application; a score calculating unit 107 configured to calculate a regionality score for each of the plurality of regions on the basis of the UU number and the number of regions for the specific application; and a determination unit 108 configured to determine whether there is regionality for the specific application on the basis of the regionality score.
    Type: Grant
    Filed: December 5, 2018
    Date of Patent: November 15, 2022
    Assignee: NTT DOCOMO, INC.
    Inventors: Keiichi Ochiai, Putri Fatina, Yusuke Fukazawa
  • Patent number: 11474683
    Abstract: A portable device and a screen control method of the portable device are provided. More specifically, disclosed are: a portable device of which the screen is changed according to a text recognition result of a text selected in response to the continuous movement of a touch received in a text display area; and a screen control method of the portable device. Some of the disclosed embodiments provide: a portable device of which the screen is changed according to control information corresponding to a text recognition result of a text selected by the continuous movement of a touch received in a text within a text display area; and a screen control method for the portable device.
    Type: Grant
    Filed: March 9, 2018
    Date of Patent: October 18, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Min-Seok Han, Min-Jin Rho, Min-Shik Sohn
  • Patent number: 11468628
    Abstract: A submersible vehicle which includes a plurality of cameras can be used to collect visual images of an object of interest submerged in a liquid environment, such as in a tank (e.g. transformer tank). In one form the submersible vehicle is remotely operated such as an ROV or an autonomous vehicle. Image information from the submersible along with inertial measurements in some embodiments is used with a vision based modelling system to form a model of an internal object of interest in the tank. The vision based modelling system can include a number of processes to form the model such as but not limited to tracking, sparse and dense reconstruction, model generation, and rectification.
    Type: Grant
    Filed: December 7, 2017
    Date of Patent: October 11, 2022
    Assignee: Hitachi Energy Switzerland AG
    Inventors: Gregory Cole, William Eakins, Daniel Lasko, Harshang Shah, Thomas Fuhlbrigge, Carlos W. Morato, Biao Zhang, Luiz Cheim, Poorvi Patel, Harald Josef Staab, Saumya Sharma
  • Patent number: 11461932
    Abstract: An apparatus for point cloud compression includes processing circuitry. The processing circuitry represents points in a point cloud using a spherical coordinate system having a first angular dimension, a second angular dimension and a radial dimension. A point is represented by a first angular coordinate in the first angular dimension, a second angular coordinate in the second angular dimension, a radial coordinate in the radial dimension and at least an attribute value. The processing circuitry forms at least a two-dimensional (2D) matrix with a first dimension corresponding to the first angular dimension and a second dimension corresponding to the second angular dimension. The point is placed as an element in the 2D matrix based on the first angular coordinate and the second angular coordinate. Further, the processing circuitry compresses data of the 2D matrix, and generates a bitstream that includes compressed data of the 2D matrix.
    Type: Grant
    Filed: June 4, 2020
    Date of Patent: October 4, 2022
    Assignee: Tencent America LLC
    Inventors: Wen Gao, Xiang Zhang, Shan Liu
  • Patent number: 11461916
    Abstract: Methods and systems for recognition of repeating geometric units in a computer image are here disclosed. According to an aspect, a representation of a computer image is split into components and every component is analyzed to identify the role of this component on the computer image. Identified components could include but are not limited to: rooms, doors, furniture etc. In one embodiment components are identified based on the presence or absence of at least one other component. The presence of a door, in a non-limiting example, could be used to denote the presence of a room. In a further embodiment, the program may extract size and perimeter information necessary for estimating needed materials from a representation of a computer image.
    Type: Grant
    Filed: June 17, 2019
    Date of Patent: October 4, 2022
    Assignee: Pixis Consulting, LLC
    Inventors: Christopher Riegle, Oleksandr Volodymyrovych Tyshchenko
  • Patent number: 11442724
    Abstract: Systems and methods of computer program code or business process design pattern recognition are provided. In embodiments, a method includes identifying, by the computing device, predefined elements and relationships between the elements in a digital industry product based on stored rules; generating, by the computing device, a diagram based on stored image rules, the diagram including graphical notations and text-based information representing the elements and the relationships between the elements; removing, by the computing device, the text-based information from the diagram to produce a modified diagram; and determining, by the computing device, that the modified diagram includes at least one predetermined pattern from a plurality of stored patterns using image object detection.
    Type: Grant
    Filed: December 4, 2019
    Date of Patent: September 13, 2022
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Zhi Peng Jia, Xiang Yu Yang, Zhi Cao, De Shuo Kong, Jing Wu, Rong Fu He
  • Patent number: 11436742
    Abstract: A system for reducing a search area for identifying correspondences identifies an overlap region within a first match frame captured by a match camera. The overlap region includes one or more points of the first match frame that are associated with one or more same portions of an environment as one or more corresponding points of a first reference frame captured by a reference camera. The system obtains a second reference frame captured by the reference camera and a second match frame captured by the match camera. The system identifies a reference camera transformation matrix, and/or a match camera transformation matrix. The system defines a search area within the second match frame based on the overlap region and the reference camera transformation matrix and/or the match camera transformation matrix.
    Type: Grant
    Filed: July 22, 2020
    Date of Patent: September 6, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Sudipta Narayan Sinha, Michael Bleyer, Christopher Douglas Edmonds, Raymond Kirk Price
  • Patent number: 11421996
    Abstract: An approach is provided for comparing and assimilating road lane representations. The approach, for example, receiving two cartographic feature representations (e.g., digital road lane representations). The approach also involves computing a geometric similarity between the cartographic representations. The approach further involves processing attribute data associated with the cartographic feature representations to determine a semantic relationship between the representations. The approach further involves generating a recommendation with respect to assimilating the representations based on the geometric similarity and the semantic relationship, and providing the recommendation as an output.
    Type: Grant
    Filed: January 24, 2020
    Date of Patent: August 23, 2022
    Assignee: HERE GLOBAL B.V.
    Inventors: Swathi Sree Durga Mudda, Shishir Saxena, Amitabh Nayar, Saurabh Dubey
  • Patent number: 11423061
    Abstract: A method is disclosed herein which comprises receiving a user request for map information at a server. The method also comprises requesting one or more base map tiles from a remote server based on the user request, the request including zoom level information and tile position information. At the server, the request is normalised based on the zoom information and the tile position information. The method then comprises defining a map view area based on the normalised request, obtaining vessel data relating to a plurality of vessels, determining for each of the plurality of vessels if the vessel lies within the map view area, and creating a new map tile comprising the vessel data for the vessels determined to lie within the map view area. The method then comprises causing display of the user requested base map tiles and overlaying the new map tile at a user device.
    Type: Grant
    Filed: September 5, 2019
    Date of Patent: August 23, 2022
    Assignee: MARITECH DEVELOPMENT LIMITED
    Inventors: Miguel Angel Cabra, Ashley Benjamin Hanks, Michail Gaziotis, Laurence Blake, Richard White, Eliad Perpinyal, Jamie Mark Shedley
  • Patent number: 11423677
    Abstract: Embodiments include apparatus and methods for automatic detection of pole-like objects for a location at a region of a roadway and automatic localization based on the detected pole-like objects. Pole-like objects are modeled as cylinders and the models are generated based on detected vertical clusters of point cloud data associated to corresponding regions along the region of the roadway. The modeled pole-like objects are stored in a database and associated with the region of the roadway. Sensor data from a user located at the region of the roadway is received. The pole-like object model is accessed and compared to the received sensor data. Based on the comparison, localization of the user located at the region of the roadway is performed.
    Type: Grant
    Filed: October 23, 2020
    Date of Patent: August 23, 2022
    Assignee: HERE Global B.V.
    Inventors: Nezih Ergin Ozkucur, Fangning He, David Doria, Engin Burak Anil
  • Patent number: 11391576
    Abstract: The invention provides a system, a method, and a computer programmable product for generating map data of a region. The method comprises obtaining image data of the region. The method further comprises determining, based on the image data, a plurality of road objects corresponding to at least one road segment associated with the region. The method further comprises generating at least one cluster of road objects corresponding to the at least one road segment, based on the plurality of road objects. The method further comprises generating the map data of the region based on the at least one cluster of road objects.
    Type: Grant
    Filed: December 2, 2019
    Date of Patent: July 19, 2022
    Assignee: HERE GLOBAL B.V.
    Inventors: Abhilshit Soni, Ashish Dhiman, Mohit Agarwal
  • Patent number: 11308334
    Abstract: A computer system executing code instructions of a visual scene feature extractor and classifier system comprising a processor executing object recognition on a captured image of a visual scene of interest including a plurality of objects in the visual scene of interest to identify a first object from the plurality of objects with a set of feature attributes wherein the feature attributes include an image view of the first object where the processor executing code instructions for the visual scene feature extractor and classifier to generate a first feature vector value for a first feature attribute of the first object.
    Type: Grant
    Filed: October 21, 2019
    Date of Patent: April 19, 2022
    Assignee: VISUAL SEMANTICS, INC.
    Inventor: Gareth Ian Block
  • Patent number: 11300968
    Abstract: A method is disclosed for use in a planning agent, the method including: identifying a first agent in a vicinity of the planning agent; identifying a location of the first agent and a velocity of the first agent; calculating a set of occupancy costs for the first agent, each occupancy cost in the set of occupancy costs being associated with a different respective location in the vicinity of the planning agent, each occupancy cost in the set of occupancy costs being calculated at least in part based on a cost function that depends on the location of the first agent and the velocity of the first agent; and changing at least one of speed or direction of travel of the planning agent based on the set of occupancy costs.
    Type: Grant
    Filed: February 22, 2019
    Date of Patent: April 12, 2022
    Assignee: Massachusetts Institute of Technology
    Inventors: Alyssa Pierson, Wilko Schwarting, Sertac Karaman, Daniela L. Rus
  • Patent number: 11288522
    Abstract: The present invention relates to a method of generating an overhead view image of an area. More particularly, the present invention relates to a method of generating a contextual multi-image based overhead view image of an area using ground map data and field of view image data. Various embodiments of the present technology can include methods, systems and non-transitory computer readable media and computer programs configured to determine a ground map of the geographical area; receiving a plurality of images of the geographical area; process the plurality of images to select a subset of images to generate the overhead view of the geographical area; divide the ground map into a plurality of sampling points of the geographical area; and determine a color of a plurality of patches of the overhead view image from the subset of images, each patch representing each sampling point of the geographical area.
    Type: Grant
    Filed: December 31, 2019
    Date of Patent: March 29, 2022
    Assignee: Woven Planet North America, Inc.
    Inventors: Clemens Marschner, Wilhelm Richert, Thomas Schiwietz, Darko Zikic
  • Patent number: 11288889
    Abstract: A computer includes a processor and a memory, the memory storing instructions executable by the processor to determine a first bounding box for a road sign in an image, identify a second bounding box for a physical member, the second bounding box for the physical member extending from the first bounding box for the road sign, and upon identifying the second bounding box for the physical member, actuate one or more vehicle components.
    Type: Grant
    Filed: July 16, 2020
    Date of Patent: March 29, 2022
    Assignee: Ford Global Technologies, LLC
    Inventors: Naman Kohli, Anuja Anil Shirsat, Sonal Doomra, Matthew Castaldini
  • Patent number: 11257230
    Abstract: Embodiments include a method for pruning anchor points from a feature map generated from a Light Detections And Ranging (LiDAR) point cloud, the method comprising: receiving, by a navigation system, a LiDAR point cloud from a LiDAR sensor, the LiDAR point cloud comprising data representing one or more objects in physical surroundings detected by the LiDAR sensor; extracting, by the navigation system, a feature map from the LiDAR point cloud, the feature map comprising a plurality of anchor points, each anchor point defined by an anchor box; smoothing, by the navigation system, the extracted feature map; determining, by the navigation system, density of pixels within the anchor box of each anchor point; and pruning, by the navigation system, anchor points from the feature map based on a plurality of factors related to the determined density of pixels within the box of each anchor point.
    Type: Grant
    Filed: February 4, 2020
    Date of Patent: February 22, 2022
    Assignee: NIO USA, Inc.
    Inventors: Zachary M. Kendrick, Disha Ahuja, Ashwath Aithal
  • Patent number: 11257231
    Abstract: A method for monocular depth/pose estimation in a camera agnostic network is described. The method includes training a monocular depth model and a monocular pose model to learn monocular depth estimation and monocular pose estimation based on a target image and context images from monocular video captured by the camera agnostic network. The method also includes lifting 3D points from image pixels of the target image according to the context images. The method further includes projecting the lifted 3D points onto an image plane according to a predicted ray vector based on the monocular depth model, the monocular pose model, and a camera center of the camera agnostic network. The method also includes predicting a warped target image from a predicted depth map of the monocular depth model, a ray surface of the predicted ray vector, and a projection of the lifted 3D points according to the camera agnostic network.
    Type: Grant
    Filed: June 17, 2020
    Date of Patent: February 22, 2022
    Assignee: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Vitor Guizilini, Sudeep Pillai, Adrien David Gaidon, Rares A. Ambrus, Igor Vasiljevic
  • Patent number: 11244517
    Abstract: Provided are a device and a method of generating printing information. The method includes acquiring at least one image part by splitting a basic image acquired based on a user input; determining a target article corresponding to the basic image from a three-dimensional (3D) article list stored in a database (DB) by using the at least one image part; providing a graphical user interface (GUI) capable of editing a shape of the target article according to a user input; and editing the shape of the target article, based on a user input via the GUI, and generating printing information used to 3D print the edited target article.
    Type: Grant
    Filed: February 15, 2016
    Date of Patent: February 8, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventor: Jae-hoon Lee
  • Patent number: 11238282
    Abstract: Systems and methods for automated detection of changes in extent of structures using imagery are disclosed, including a non-transitory computer readable medium storing computer executable code that when executed by a processor cause the processor to: align, with an image classifier model, a structure shape of a structure at a first instance of time to pixels within an aerial image depicting the structure captured at a second instance of time; assess a degree of alignment between the structure shape and the pixels, so as to classify similarities between the structure depicted within the pixels and the structure shape using a machine learning model to generate an alignment confidence score; and determine an existence of a change in the structure based upon the alignment confidence score indicating a level of confidence below a predetermined threshold level of confidence that the structure shape and the pixels within the aerial image are aligned.
    Type: Grant
    Filed: June 3, 2020
    Date of Patent: February 1, 2022
    Assignee: Pictometry International Corp.
    Inventors: Stephen Ng, David R. Nilosek, Phillip Salvaggio, Shadrian Strong
  • Patent number: 11232251
    Abstract: Systems, devices and methods operative for identifying a reference within a figure and an identifier in a text associated with the figure, the reference referring to an element depicted in the figure, the reference corresponding to the identifier, the identifier identifying the element in the text, placing the identifier on the figure at a distance from the reference, the identifier visually associated with the reference upon the placing, the placing of the identifier on the figure is irrespective of the distance between the identifier and the reference.
    Type: Grant
    Filed: May 26, 2019
    Date of Patent: January 25, 2022
    Inventors: Roman Tsibulevskiy, Barry Greenbaum
  • Patent number: 11202055
    Abstract: A stereoscopic vision system captures stereoscopic images. The stereoscopic images are processed to rapidly discriminate between portions of the images that are on a ground-plane and those that are off the ground plane. The discrimination is based on comparing locations within the images using an expected disparity shift.
    Type: Grant
    Filed: February 28, 2018
    Date of Patent: December 14, 2021
    Assignee: BlackBerry Limited
    Inventor: Gordon Bell
  • Patent number: 11134191
    Abstract: An image display method includes obtaining, by an electronic device, a first instruction triggered by a user, where the first instruction instructs the electronic device to display a panoramic image. The method further includes obtaining, by the electronic device in response to the first instruction, historical bearing information and real-time bearing information of a camera lens of the electronic device, where the historical bearing information indicates a historical bearing of the camera lens that is measured when the panoramic image is shot, and the real-time bearing information indicates a current target bearing of the camera lens. The method further includes displaying, by the electronic device, a target picture corresponding to the target bearing in the panoramic image when the historical bearing information includes the target bearing.
    Type: Grant
    Filed: April 26, 2017
    Date of Patent: September 28, 2021
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Wenlong Zhao, Guangxue Sun
  • Patent number: 11113290
    Abstract: An exemplary embodiment includes a system for an information visualization engine designed to dynamically organize, via associative clustered tiling and tessellation, and then present instantly addressable content via any electronic user interface, but especially via mobile devices such as touch screen cellular phones, and tablets.
    Type: Grant
    Filed: May 29, 2018
    Date of Patent: September 7, 2021
    Assignee: CLUSTER COMMUNICATIONS, INC.
    Inventors: Edward Russell Braziel, Eric Matthew Penner
  • Patent number: 11094198
    Abstract: This application discloses a lane determining method performed at a computing device. The computing device obtains image information of a road surface image collected by a vehicle; identifies first lane information of at least one first lane of the road surface from the image information, the first lane information including a location relationship between a travelling lane in which the vehicle is located in the road surface and the at least one first lane, and a feature of the first lane; performs feature matching between the feature of the at least one first lane and a feature of at least one second lane in a map in which the road surface is located, the feature of the at least one second lane obtained from the map; and determines a target lane of the vehicle in the map corresponding to the travelling lane in the map in accordance with the feature matching result.
    Type: Grant
    Filed: June 12, 2019
    Date of Patent: August 17, 2021
    Inventor: Yujin Fu
  • Patent number: 11048257
    Abstract: Controlling an unmanned aerial vehicle may include obtaining a first image from a fixed orientation image capture device of the unmanned aerial vehicle, obtaining a second image from an adjustable orientation image capture device of the unmanned aerial vehicle, obtaining feature correlation data based on the first image and the second image, obtaining relative image capture device orientation calibration data based on the feature correlation data, the relative image capture device orientation calibration data indicating an orientation of the adjustable orientation image capture device relative to the fixed orientation image capture device, obtaining relative object orientation data based on the relative image capture device orientation calibration data, the relative object orientation data representing a three-dimensional orientation of an external object relative to the adjustable orientation image capture device, and controlling a trajectory of the unmanned aerial vehicle in response to the relative object
    Type: Grant
    Filed: February 27, 2018
    Date of Patent: June 29, 2021
    Assignee: GoPro, Inc.
    Inventors: Sammy Omari, Pascal Gohl, Axel Murguet, Garance Bruneau, Fabio Diem, Lukas Schmid
  • Patent number: 11037011
    Abstract: A method for acquiring images of the surface of the earth, installing an aerial platform in a quasi-stationary position, equipped with an image acquisition system with a large field of view and a second, high-resolution, image acquisition system is disclosed. The method includes implementing successive observation cycles, each one including the acquisition of an image of a zone of interest by the first system, the partitioning of the image thus acquired into mesh units which each correspond to a sector of the zone of interest, the analysis of the image in order to detect the potential presence of unwanted marks, and the acquisition of an image by the second system for the mesh units for which no unwanted marks have been detected. Observation cycles are thereby implemented until images of the entire zone of interest have been acquired by the second system.
    Type: Grant
    Filed: November 8, 2018
    Date of Patent: June 15, 2021
    Assignee: Airbus Defence and Space SAS
    Inventor: Pierre-Luc Georgy
  • Patent number: 11022442
    Abstract: Methods, devices, and systems for indoor mapping are described herein. The methods include providing an indoor map containing a current location of a user device, the indoor map having a containing exterior space, a contained interior space within the containing exterior space, and a linkage, the linkage having a coordinate transformation to project coordinates of the interior space onto coordinates of the exterior space. The methods also include receiving a point of interest, determining a path from the current location to the point of interest, the current location and the point of interest being in walkable areas, the path including a transition between the interior space and the exterior space, and providing instructions to navigate along the path, the coordinates of the interior space and the coordinates of the exterior space are referenced by either the instructions prior to the transition and the instructions after the transition.
    Type: Grant
    Filed: March 15, 2018
    Date of Patent: June 1, 2021
    Assignee: MappedIn Inc.
    Inventors: Patrick Paskaris, Erkang Wei, James Nathan Swidersky, Sarah Knight, Mitchell Butler