3-d Or Stereo Imaging Analysis Patents (Class 382/154)
  • Patent number: 11657529
    Abstract: An example operation of depth map generation includes one or more of, simultaneously capturing a main-off camera image and an auxiliary-off camera image with an unpowered flash, sparse depth mapping an object based on the main-off camera image and the auxiliary-off camera image, capturing a main-on camera image with a powered flash, foreground probability mapping the object based on the main-off camera image and the main-on camera image and dense depth mapping the object based on the sparse depth map and the foreground probability map.
    Type: Grant
    Filed: October 12, 2020
    Date of Patent: May 23, 2023
    Assignee: Black Sesame Technologies Inc.
    Inventors: Chao Wang, Donghui Wu
  • Patent number: 11657521
    Abstract: The present application discloses a 3D imaging method, device and depth camera, wherein, the 3D imaging method includes: acquiring depth information of points in a to-be-captured scene corresponding to at least one pixel; generating a 3D image of the to-be-captured scene based on the acquired depth information; and determining the depth information of the each of the points in the to-be-captured scene corresponding to the at least one pixel based on a result of the distributing. This implementation utilizes multiple charge collection areas to collect the charges obtained by photoelectric conversion of the light that reaches the pixels, thereby achieving the capture of the depth information of points in the to-be-captured scene corresponding to each pixel.
    Type: Grant
    Filed: September 2, 2020
    Date of Patent: May 23, 2023
    Assignee: Rayz Technologies Co. Ltd.
    Inventors: Detao Du, Ruxin Chen
  • Patent number: 11657072
    Abstract: An apparatus, or corresponding method, for building or updating a map database is described. In one example, the apparatus includes an image correlation module, a training device, and a learned model or neural network. The image correlation module is configured to correlate a first aerial image and terrestrial sensor data collected at a terrestrial vehicle based on at least one control point from the terrestrial data. The learned model training device is configured to define a learned model based using at least one control point from the terrestrial sensor data as ground truth for analysis of the first aerial image. The learned model inference module is configured to receive a second aerial image and apply the learned model on the second aerial image for identification of mapping information for the map data.
    Type: Grant
    Filed: May 16, 2019
    Date of Patent: May 23, 2023
    Assignee: HERE Global B.V.
    Inventors: Jan Van Sickle, Nicholas Dronen
  • Patent number: 11657572
    Abstract: Systems and methods for generating a map. The methods comprise: performing, by a computing device, ray-casting operations to generate a 3D point cloud with a reduced number of data points associated with moving objects; generating, by the computing device, a 2D binary mask for at least one semantic label class of the 3D point cloud; determining, by the computing device, x-coordinates and y-coordinates for a 2D volume defining an object of the at least one semantic label class; identifying, by the computing device, data points in the 3D point cloud based on the 2D volume; comparing, by the computing device, z-coordinates of the identified data points to at least one threshold value selected for the at least one semantic label class; and generating, by the computing device, the map by removing data points from the 3D point cloud based on results of the comparing.
    Type: Grant
    Filed: October 21, 2020
    Date of Patent: May 23, 2023
    Assignee: argo ai, llc
    Inventor: Yong-Dian Jian
  • Patent number: 11659154
    Abstract: An apparatus including a stereo camera and a processor. The stereo camera may comprise a first capture device and a second capture device in a vertical orientation. The first capture device may be configured to generate first pixel data and the second capture device may be configured to generate second pixel data. The processor may be configured to receive the first pixel data and the second pixel data, generate a vertical disparity image in response to the first pixel data and the second pixel data, generate a virtual horizontal disparity image in response to the first pixel data and the vertical disparity image and detect objects by analyzing the vertical disparity image and the virtual horizontal disparity image. An analysis of the virtual horizontal disparity image may enable the processor to detect the objects not detected in the vertical disparity image alone.
    Type: Grant
    Filed: February 25, 2022
    Date of Patent: May 23, 2023
    Assignee: Ambarella International LP
    Inventors: Omar Pighi, Alessandro Pacchioni
  • Patent number: 11650334
    Abstract: A method for applying GPS UAV attitude estimation to accelerate computer vision. The UAV has a plurality of GPS receivers mounted at fixed locations on the UAV. The method includes receiving GPS signals from each GPS satellite in view of the UAV, the GPS measurements comprising pseudo-range and carrier phase data representing the distance between each GPS receiver and each GPS satellite. Carrier phase and pseudo-range measurements are determined for each GPS receiver based on the pseudo-range and carrier phase data. The GPS carrier phase and pseudo-range measurements are compared pair-wise for each pair of GPS receiver and satellite. An attitude of the UAV is determined based on the relative distance measurements. A 3D camera pose rotation matrix is determined based on the attitude of the UAV. Computer vision image search computations are performed for analyzing the image data received from the UAV in real time using the 3D camera pose rotation matrix.
    Type: Grant
    Filed: December 30, 2020
    Date of Patent: May 16, 2023
    Assignee: International Business Machines Corporation
    Inventors: Mahanth K. Gowda, Justin G. Manweiler, Justin D. Weisz
  • Patent number: 11651519
    Abstract: An automated rack imaging system is provided, including an automated guided vehicle having a housing and a propulsion system configured to move the housing. The automated rack imaging system may include an imaging system coupled to the housing. The imaging system may include a plurality of cameras. The cameras each may be configured to have a respective field of view. The fields of view may be at least partially non-overlapping with one another. The automated rack imaging system may also include an image processor configured to combine a plurality of images taken by the cameras into a single mosaic image. A method of imaging a datacenter rack with the automated guided vehicle is also provided. The method may include moving the automated guided vehicle to a first target location aligned with the datacenter rack, taking the plurality of images, and combining the plurality of images into the single mosaic image.
    Type: Grant
    Filed: September 29, 2020
    Date of Patent: May 16, 2023
    Assignee: Google LLC
    Inventors: Christopher James Coomes, John Zevenbergen, Nivedita Ravi, Joseph Reichenbach
  • Patent number: 11651553
    Abstract: A method and a system for generating a mesh representation of a surface. The method includes receiving a three-dimensional (3D) point cloud representing the surface, generating a reconstruction dataset having a higher resolution than the 3D point cloud in one or more regions corresponding to the surface from the 3D point cloud, and generate a polygon mesh representation of the surface by using a fine-to-coarse hash map for building polygons at a highest resolution first followed by progressively coarser resolution polygons, using the reconstruction dataset.
    Type: Grant
    Filed: September 24, 2021
    Date of Patent: May 16, 2023
    Assignee: argo ai, llc
    Inventors: Xiaoyan Hu, Michael Happold, Joshua Max Manela, Guy Hotson
  • Patent number: 11653023
    Abstract: There is provided an encoding device, an encoding method, a decoding device, and a decoding method capable of generating a more accurate three-dimensional model. A three-dimensional model generating unit generates three-dimensional model information representing a three-dimensional model of a subject on the basis of a plurality of captured images and active depth information, and a conversion processing unit converts the three-dimensional model represented by the three-dimensional model information into a plurality of two-dimensional images by projecting the three-dimensional model from a plurality of directions, and generates depth information representing a depth from an arbitrary viewpoint to the three-dimensional model by using the plurality of two-dimensional images. Then, transmit data including the plurality of two-dimensional images, the depth information, and the active depth information is transmitted to the decoding device.
    Type: Grant
    Filed: November 16, 2018
    Date of Patent: May 16, 2023
    Assignee: SONY CORPORATION
    Inventor: Hisako Sugano
  • Patent number: 11645558
    Abstract: A method, a computer system, and a computer program product for mapping operational records to a topology graph. Embodiments of the present invention may include generating an event frequent pattern using operational records. Embodiments of the present invention may include integrating topology-based event frequent patterns. Embodiments of the present invention may include mapping the operational records with an embedding engine. Embodiments of the present invention may include predicting incident events. Embodiments of the present invention may include receiving labeled patterns to the embedding engine for an active learning cycle.
    Type: Grant
    Filed: May 8, 2020
    Date of Patent: May 9, 2023
    Assignee: International Business Machines Corporation
    Inventors: Qing Wang, Larisa Shwartz, Srinivasan Parthasarathy, Jinho Hwang, Tengfei Ma, Michael Elton Nidd, Frank Bagehorn, Jakub Krchák, Altynbek Orumbayev, Michal Mýlek, Ota Sandr, Tomá{hacek over (s)} Ondrej
  • Patent number: 11647176
    Abstract: An image capture method may include obtaining two or more sets of images. The two or more sets of images may include a first image captured by a first image capture device and a second image captured by a second image capture device. The method may also include determining, for a set of images, two or more pairs of points. Each of the two or more pairs of points may include a first point in the first image and a second point in the second image, and the first point and the second point may correspond to a same object. The method may also include determining a first rotation matrix based on the pairs of points in the two or more sets of images. The first rotation matrix may be associated with a relationship between positions of the first image capture device and the second image capture device.
    Type: Grant
    Filed: June 25, 2021
    Date of Patent: May 9, 2023
    Assignee: ZHEJIANG DAHUA TECHNOLOGY CO., LTD.
    Inventors: Chengzhe Meng, Huadong Pan, Mei Gao
  • Patent number: 11640677
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for navigation using planar landmarks. In some implementations, images depicting an area of a property captured by a camera are obtained. Landmarks in the area are identified based on the images. An expected stability for each of the landmarks are determined. A map for the area is generated based on the expected stability for each of the landmarks. The map is transmitted to one or more electronic devices.
    Type: Grant
    Filed: October 15, 2020
    Date of Patent: May 2, 2023
    Assignee: Alarm.com Incorporated
    Inventors: Daniel Todd Kerzner, Ahmad Seyfi, Timon Meyer, Donald Gerard Madden, Babak Rezvani, Glenn Tournier
  • Patent number: 11640673
    Abstract: The invention relates to a method and a system for measuring an object (2) by means of stereoscopy, in which method a pattern (3) is projected onto the object surface by means of a projector (9) and the pattern (3), which is designated as a scene and is projected onto the object surface, is captured by at least two cameras (4.1, 4.2, 4.3, 4.4), wherein correspondences of the scene are found in the images captured by the cameras (4.1, 4.2, 4.3, 4.4) by means of a computing unit (5) using image processing, and the object (2) is measured by means of the correspondences found. According to the invention, the cameras (4.1, 4.2, 4.3, 4.4) are intrinsically and extrinsically calibrated, and a two-dimensional and temporal coding is generated during the pattern projection, by (a) projecting a (completely) two-dimensionally coded pattern (3) and capturing the scene using the cameras (4.1, 4.2, 4.3, 4.
    Type: Grant
    Filed: April 12, 2019
    Date of Patent: May 2, 2023
    Assignee: ISRA VISION AG
    Inventors: Holger Wirth, Peter Neugebauer, Manuel Scholz, Enis Ersü
  • Patent number: 11636649
    Abstract: A geospatial modeling system may include a memory and a processor cooperating therewith to generate a three-dimensional (3D) geospatial model including geospatial voxels based upon a plurality of geospatial images, obtain a newly collected geospatial image, and determine a reference geospatial image from the 3D geospatial model using Artificial Intelligence (AI) and based upon the newly collected geospatial image. The processor may further align the newly collected geospatial image and the reference geospatial image to generate a predictively registered image, and update the 3D geospatial model based upon the predictively registered image.
    Type: Grant
    Filed: January 6, 2021
    Date of Patent: April 25, 2023
    Assignee: EAGLE TECHNOLOGY, LLC
    Inventors: Donald Alan Lieb, Bill Watkins, Glenn Boudreaux, John L. Delay, Mark D. Elstrom, Mark D. Rahmes, Patrick Cowhill
  • Patent number: 11636614
    Abstract: A three-dimensional geometry measurement apparatus including: a relationship identification part that identifies a combination of a first imaging pixel and a projection pixel of a projection image; a determination part that determines, for the combination of the first imaging pixel and the projection pixel, whether or not the combination includes a defective pixel on the basis of a distance between (i) a second imaging pixel corresponding to the same projection coordinate as a projection coordinate corresponding to the first imaging pixel and (ii) a second imaging pixel corresponding to the projection coordinate of the projection pixel and located on an epipolar line of a second captured image corresponding to the projection coordinate; and a geometry measurement part that measures a geometry of an object to be measured using at least one of the first imaging pixel excluding the defective pixel or the second imaging pixel excluding the defective pixel.
    Type: Grant
    Filed: May 10, 2022
    Date of Patent: April 25, 2023
    Assignee: MITUTOYO CORPORATION
    Inventor: Kaoru Miyata
  • Patent number: 11636618
    Abstract: A simultaneous localization and mapping device is provided. The device includes an image obtaining device configured to capture color images and depth images of a surrounding environment; an initial pose estimating device configured to estimate an initial pose based on the color images and the depth images; a map constructing device configured to construct a three-dimensional map based on the depth images and the color images; and a pose determining device configured to determine a final pose based on the initial pose and the three-dimensional map.
    Type: Grant
    Filed: November 10, 2020
    Date of Patent: April 25, 2023
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Tianhao Gao, Xiaolong Shi, Xiongfeng Peng, Kuan Ma, Hongseok Lee, Myungjae Jeon, Qiang Wang, Yuntae Kim, Zhihua Liu
  • Patent number: 11630436
    Abstract: The present invention provides a measurement program selection assisting apparatus capable of visually confirming whether a selected measurement program is suitable for an object to be measured. One aspect of the present invention is a measurement program selection assisting apparatus comprising: a measurement program database storing a measurement program related to measurement of an object and superimposed display information corresponding to a three-dimensional shape of the object in association with each other; a display unit capable of displaying information defined in a virtual space superimposed on the real space; and a display control unit for acquiring the superimposed display information corresponding to a selected measurement program from the measurement program database and displaying the acquired superimposed display information in a mixed reality on the display unit.
    Type: Grant
    Filed: October 17, 2019
    Date of Patent: April 18, 2023
    Assignee: MITUTOYO CORPORATION
    Inventors: Shinsaku Abe, Kuniyuki Nuka
  • Patent number: 11631501
    Abstract: A system for calculating one or more health indicators, comprising a body volume calculator arranged to use measurement data to calculate the volume of at least a part of a subject's body and a length measurement of at least a part of a subject; and processing circuitry arranged to receive information, which may be demographic information, about the subject and the body part volume and length measurements; and to perform at least one of: calculating a predicted Visceral Fat value and/or a predicted Total Body Fat value from the demographic information, the body part volume and length measurements using first and second formulae, which may be empirical formulae, respectively; and calculating a Body Volume Indicator (BVI) arranged to provide an indication of health risk, in particular obesity and cardio-metabolic risk, which may be by using a third formula, which again may be an empirical formula.
    Type: Grant
    Filed: July 20, 2021
    Date of Patent: April 18, 2023
    Assignee: Select Research Limited
    Inventor: Richard Barnes
  • Patent number: 11628314
    Abstract: Magnetic resonance (MR) guided radiation therapy (MRgRT) enables control over the delivery of radiation based on patient motion indicated by MR imaging (MRI) images captured during radiation delivery. A method for MRgRT includes: simultaneously using one or more radiation therapy heads to deliver radiation and an MRI system to perform MRI; using a processor to determine whether one or more gates are triggered based on at least a portion of MRI images captured during the delivery of radiation; and in response to determining that one or more gates are triggered based on at least a portion of the MRI images captured during the delivery of radiation, suspending the delivery of radiation.
    Type: Grant
    Filed: January 7, 2021
    Date of Patent: April 18, 2023
    Assignee: VIEWRAY TECHNOLOGIES, INC.
    Inventors: James F. Dempsey, Iwan Kawrykow
  • Patent number: 11624907
    Abstract: The present disclosure relates to a method and a device for acquisition of a metric of an eye (1) located in an acquisition space (29). The device comprises at least one light source (11) configured to emit light towards the acquisition space, a camera (15) configured to receive light from the acquisition space to (29) generate image data, and an analyzing unit (14) configured to extract at least one metric from the image data. The camera (15) is configured to receive light from the acquisition space via at least two light paths (17, 19) which are differently angled with respect to the optical axis of the camera, the light of at least one path being received via a first mirror (21). The camera receives light from an overlapping portion of the acquisition space via the first and second paths, as to allow the camera to receive at least two representations of a single eye. This metric may be used for e.g. eye tracking or autorefraction/accomodation.
    Type: Grant
    Filed: November 3, 2017
    Date of Patent: April 11, 2023
    Inventor: Hans-Peter Kurz
  • Patent number: 11625907
    Abstract: Systems and methods are disclosed, including a non-transitory computer readable medium storing computer executable instructions that when executed by a processor cause the processor to identify a first image, a second image, and a third image, the first image overlapping the second image and the third image, the second image overlapping the third image; determine a first connectivity between the first image and the second image; determine a second connectivity between the first image and the third image; determine a third connectivity between the second image and the third image, the second connectivity being less than the first connectivity, the third connectivity being greater than the second connectivity; assign the first image, the second image, and the third image to a cluster based on the first connectivity and the third connectivity; conduct a bundle adjustment process on the cluster of the first image, the second image, and the third image.
    Type: Grant
    Filed: October 23, 2020
    Date of Patent: April 11, 2023
    Assignee: Pictometry International Corp.
    Inventor: David Nilosek
  • Patent number: 11625872
    Abstract: An exemplary computing system for locating an object in an operational area is disclosed. The computing system having a server and plurality of edge devices. The edge devices having an image sensor configured to capture video data of the operational area from a specified location. The edge devices can process the video data to identify an object and generate a two-dimensional shape representative of the object, generate a vector from a lens of the image sensor through a center point of the two-dimensional shape; and determine relative position of the two-dimensional shape based on geospatial information of the edge device and the vector. The server and one or more of the edge devices receiving video data from a plurality of edge devices and generating a graphic, which defines a position of the object within the operational area based on the vector and location information of each edge device.
    Type: Grant
    Filed: March 25, 2020
    Date of Patent: April 11, 2023
    Assignee: BOOZ ALLEN HAMILTON INC.
    Inventors: Rory Burke, James J Ter Beest, III
  • Patent number: 11620771
    Abstract: Computing a relative-head-orientation relative to a moving-reference. First and second data are received. The first data are indicative of a head-orientation of a head of a user. The second data are indicative of at least one of: a location, a motion, an orientation, a velocity and an acceleration of the user. A head-orientation is computed according to the first data. A moving-reference is updated by an adjustment toward the head-orientation, to produce an updated-moving-reference. The amount of adjustment is indicated by processing the second data. A relative-head-orientation is computed relative to the updated-moving-reference. Binaural audio is rendered in accordance with the relative-head-orientation.
    Type: Grant
    Filed: November 1, 2021
    Date of Patent: April 4, 2023
    Assignee: Waves Audio Ltd.
    Inventors: Matan Ben-Asher, Meir Shashoua, Gal Alchanati, Nadav Nehoran
  • Patent number: 11620478
    Abstract: In described examples, an apparatus includes an object detection (OD) network that is configured to generate OD polygons in response to a received at least one camera image and a semantic segmentation (SS) network that is configured to generate SS data in response to the received at least one camera image. A processor is configured to generate an updated occupancy grid in response to the OD polygons and the SS data. A vehicle is optionally configured to respond to a driving action generated in response to the updated occupancy grid.
    Type: Grant
    Filed: February 6, 2020
    Date of Patent: April 4, 2023
    Assignee: Texas Instruments Incorporated
    Inventors: Soyeb Noormohammed Nagori, Deepak Poddar, Hrushikesh Tukaram Garud
  • Patent number: 11612762
    Abstract: A camera monitoring system for a bore based medical apparatus is described, wherein the camera monitoring system comprises a first and a second image sensor mounted on opposing surfaces of a circuit board. The first image sensor is arranged to view an object from a first viewpoint via a first lens arrangement and a first mirror and the second image sensor is arranged to view the object from a second viewpoint via a second lens arrangement and a second mirror. By having the image sensors view an object via the mirrors, via the lens arrangements, the lens arrangements contribute to the effective separation of the first and second viewpoints enabling the size of the housing of the camera to be reduced. Furthermore, a method for calibrating a camera monitoring system in a bore based setup is described and also a configuration of arranging a camera monitoring system in connection with a bore based medical apparatus.
    Type: Grant
    Filed: April 17, 2019
    Date of Patent: March 28, 2023
    Assignee: VISION RT LIMITED
    Inventor: Gideon M. Hale
  • Patent number: 11615588
    Abstract: Methods and systems for improved generation and georeferencing of floor plans are presented. In one embodiment, a method is presented that includes receiving images that depict sheets of a blueprint of a structure. Subsets of the images depicting floor sheets and elevation sheets may be identified. Exterior contours may be extracted from the images depicting floor sheets and elevation contours may be extracted from the images depicting elevation sheets. A corresponding structure within a three-dimensional map may be identified based on the exterior contours and the elevation contours. A three-dimensional contour of the exterior of the structure may be extracted from the three-dimensional map.
    Type: Grant
    Filed: April 13, 2021
    Date of Patent: March 28, 2023
    Inventor: Charles C. Carrington
  • Patent number: 11615615
    Abstract: The present invention discloses a method and an apparatus for extracting mountain landscape buildings based on high-resolution remote sensing images. The method comprises: segmenting a remote sensing image, and extracting non-vegetation areas from the remote sensing image by using NDVI; segmenting the non-vegetation areas, and extracting building areas by using NDBI; segmenting the building areas again, and calculating a normalized difference build shadow index NSBI of each patch; calculating NSBI separator of each patch in the non-vegetation areas and setting a separator threshold, and extracting landscape building areas based on the threshold. In the present invention, by introducing a near infrared band in the remote sensing image spectrum, in which there is a significant difference between shadows and non-shadows, the influence of large shadow areas in mountainous shady areas in the remote sensing image on the result of extraction is reduced.
    Type: Grant
    Filed: January 21, 2021
    Date of Patent: March 28, 2023
    Assignee: SOUTHEAST UNIVERSITY
    Inventors: Zhe Li, Yukun He, Yuning Cheng, Xiang Zhou, Kaiyu Zhao, Xiao Han, Feifei Chen, Shuang Song, Xinyi Lu, Xiaoshan Lin
  • Patent number: 11610373
    Abstract: The method of generating three-dimensional model data of an object includes estimating pose data of the object based on the first view data of the camera and first relative pose data of the object, and estimating second relative pose data of the object based on the pose data of the object and the second view data of the camera.
    Type: Grant
    Filed: November 11, 2020
    Date of Patent: March 21, 2023
    Assignee: NAVER LABS CORPORATION
    Inventors: Yeong Ho Jeong, Dong Cheol Hur, Sang Wook Kim
  • Patent number: 11611734
    Abstract: An electronic device can include a first image sensor configured to capture a first image of a field of view and a second image sensor configured to capture a second image of the field of view. The electronic device can include a color filter adjacent to the second image sensor such that the field of view is viewable by the second image sensor through the color filter. The first image can have a first pixel resolution. The second image can have a second pixel resolution. The electronic device can include a controller configured to determine a third image based on luminance content of the first image and color content of the second image. The third image can have a third pixel resolution indicative of a spatial resolution of the first image and a spectral resolution of the second image.
    Type: Grant
    Filed: March 26, 2020
    Date of Patent: March 21, 2023
    Assignee: Google LLC
    Inventors: Sam D'Amico, Xiaoyu Miao, Babak Parviz
  • Patent number: 11604278
    Abstract: A three-dimensional distance measurement device includes a light emitting unit that irradiates a subject with light; a light receiving unit that detects reflected light from the subject; a distance calculation unit that calculates a three-dimensional distance to the subject on the basis of a transmission time of the detected reflected light; an image processing unit that generates a distance image of the subject on the basis of the calculated distance data; and a distance mode selection processing unit that selects a predetermined distance mode from a plurality of distance modes having different measurable distance ranges and sets a driving condition of the light emitting unit. By selecting a first distance mode in a first frame and selecting a second distance mode in a second frame, and by combining the distance data acquired in the respective frames, three-dimensional distance data of a frame to be output is generated.
    Type: Grant
    Filed: April 27, 2020
    Date of Patent: March 14, 2023
    Assignee: HITACHI-LG DATA STORAGE, INC.
    Inventor: Katsuhiko Izumi
  • Patent number: 11605321
    Abstract: A three-dimensional-image display device includes a display unit, a variable focus lens unit, and a controller. The display unit sequentially displays a first image displayed by a first image signal and a second image displayed by a second image signal, and that projects a display light of the first image and a display light of the second image. The variable focus lens unit switches the focal lengths for the display lights to respectively form, as virtual images, the first image and the second image on a first display surface and a second display surface. The controller controls, on the basis of a start timing at which writing, of an image signal of a different image, to pixels of the display unit starts, a projecting timing at which the display unit projects the display light of the first image and the display light of the second image.
    Type: Grant
    Filed: December 21, 2021
    Date of Patent: March 14, 2023
    Assignee: Wuhan Tianma Micro-Electronics Co., Ltd.
    Inventors: Naoyasu Ikeda, Tetsushi Sato
  • Patent number: 11605183
    Abstract: A method for aligning and merging contents from multiple collaborative workstations. Collaborative workstations are multiple workstations that contribute respective contents to be combined into a single computer-generated output. The content generated from each collaborative workstation is the collaborative content. Individual collaborative content is created from each workstation by a user drawing on a piece of paper that is placed on a workspace surface of the workstation. Collaborative contents contributed by multiple workstations are aligned such that a combined product (i.e., a single computer-generated output) including both virtual and physical content appears to be collaboratively drawn by multiple users on a single piece of paper.
    Type: Grant
    Filed: September 30, 2019
    Date of Patent: March 14, 2023
    Assignee: Konica Minolta Business Solutions U.S.A., Inc.
    Inventors: Jie Kulbida, Ronald O'Farrell, David Beck, Kevin Beck, Jason Grams
  • Patent number: 11604062
    Abstract: A method of determining dimensional information of a target surface includes generating a first point cloud corresponding to a first plurality of reconstructed surface points of the target surface generated by a first imaging system-illumination source pair of a phase profilometry system; generating a second point cloud corresponding to a second plurality of reconstructed surface points of the target surface generated by a second imaging system-illumination source pair of the phase profilometry system; generating an initial estimate of the target surface based on the first and second point clouds; and refining the initial surface estimate using positions of the first and second point clouds and geometry of the first and second imaging system-illumination source pairs to generate a final point cloud.
    Type: Grant
    Filed: December 7, 2020
    Date of Patent: March 14, 2023
    Assignee: CyberOptics Corporation
    Inventors: Paul R. Haugen, Evan J. Ribnick, Carl E. Haugan, Eric P. Rudd
  • Patent number: 11600008
    Abstract: The disclosure provides human-tracking methods, systems, and storage media. The method includes: acquiring a plurality of human point clouds of a current frame from a plurality of cameras; generating a total point cloud of the current frame by integrating the plurality of human point clouds of the current frame; acquiring a plurality of human point clouds of a next frame from the plurality of cameras; acquiring a total point cloud of the next frame by integrating the plurality of human point clouds of the next frame; and performing human tracking based on the total point cloud of the current frame and the total point cloud of the next frame.
    Type: Grant
    Filed: March 13, 2020
    Date of Patent: March 7, 2023
    Assignee: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
    Inventors: Chengyue Zhang, Le Kang, Hongtian Yang, Song Yang, Tao Liu, Jingxi Lu, Yingze Bao, Mingyu Chen, Hongwu Zhang, Zeyu Liu
  • Patent number: 11601631
    Abstract: A method of image processing in a structured light imaging device is provided that includes capturing a plurality of images of a scene into which a structured light pattern is projected by a projector in the structured light imaging device, extracting features in each of the captured images, finding feature matches between a reference image of the plurality of captured images and each of the other images in the plurality of captured images, rectifying each of the other images to align with the reference image, wherein each image of the other images is rectified based on feature matches between the image and the reference image, combining the rectified other images and the reference image using interpolation to generate a high resolution image, and generating a depth image using the high resolution image.
    Type: Grant
    Filed: August 11, 2020
    Date of Patent: March 7, 2023
    Assignee: Texas Instruments Incorporated
    Inventors: Vikram VijayanBabu Appia, Ibrahim Ethem Pekkucuksen
  • Patent number: 11600043
    Abstract: A computer program product may cause one or more processors to generate stereoscopic images of one or more 3D models within a 3D model space. As part of the generation of the stereoscopic images, special case surfaces that are non-flat and specularly reflective or refractive are rendered in a special manner. The special manner involves rendering a texture for the special case surface based on a third projection corresponding to a third viewpoint that is spaced from both a first viewpoint (i.e., a left eye viewpoint) and a second viewpoint (i.e., a right eye viewpoint). Accordingly, when rendering first and second images (i.e., images corresponding respectively to the first and second viewpoints), the texture corresponding to the third viewpoint may be applied to the special case surface in both the first and second images.
    Type: Grant
    Filed: October 1, 2021
    Date of Patent: March 7, 2023
    Assignee: Tanzle, Inc.
    Inventors: Joseph L. Grover, Oliver T. Davies
  • Patent number: 11600071
    Abstract: A visible light sensor may be configured to sense environmental characteristics of a space using an image of the space. The visible light sensor may be controlled in one or more modes, including a daylight glare sensor mode, a daylighting sensor mode, a color sensor mode, and/or an occupancy/vacancy sensor mode. In the daylight glare sensor mode, the visible light sensor may be configured to decrease or eliminate glare within a space. In the daylighting sensor mode and the color sensor mode, the visible light sensor may be configured to provide a preferred amount of light and color temperature, respectively, within the space. In the occupancy/vacancy sensor mode, the visible light sensor may be configured to detect an occupancy/vacancy condition within the space and adjust one or more control devices according to the occupation or vacancy of the space. The visible light sensor may be configured to protect the privacy of users within the space via software, a removable module, and/or a special sensor.
    Type: Grant
    Filed: December 11, 2017
    Date of Patent: March 7, 2023
    Assignee: Lutron Technology Company LLC
    Inventors: Craig Alan Casey, James P. Steiner
  • Patent number: 11592732
    Abstract: In described examples, a geometric progression of structured light elements is iteratively projected for display on a projection screen surface. The displayed progression is for determining a three-dimensional characterization of the projection screen surface. Points of the three-dimensional characterization of a projection screen surface are respaced in accordance with a spacing grid and an indication of an observer position. A compensated depth for each of the respaced points is determined in response to the three-dimensional characterization of the projection screen surface. A compensated image can be projected on the projection screen surface in response to the respaced points and respective compensated depths.
    Type: Grant
    Filed: May 5, 2020
    Date of Patent: February 28, 2023
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Jaime Rene De La Cruz, Jefferey Mathew Kempf
  • Patent number: 11595632
    Abstract: Example embodiments described herein relate to a camera configuration system to perform operations that include: capturing an image at a sensor device, the image comprising a set of image features; accessing a calibration template in response to the capturing the image at the sensor device; generating a presentation of the image, the presentation of the image including a display of the calibration template overlaid upon the image; and causing display of the presentation of the image at a client device.
    Type: Grant
    Filed: December 20, 2019
    Date of Patent: February 28, 2023
    Assignee: Samsara Networks Inc.
    Inventors: Evaline Shin-Tin Tsai, Ishaan Kansal, Kieran K. Gupta
  • Patent number: 11593458
    Abstract: Implementations are directed to receiving a set of training data including a plurality of data points, at least a portion of which are to be labeled for subsequent supervised training of a computer-executable machine learning (ML) model, providing at least one visualization based on the set of training data, the at least one visualization including a graphical representation of at least a portion of the set of training data, receiving user input associated with the at least one visualization, the user input indicating an action associated with a label assigned to a respective data point in the set of training data, executing a transformation on data points of the set of training data based on one or more heuristics representing the user input to provide labeled training data in a set of labeled training data, and transmitting the set of labeled training data for training the ML model.
    Type: Grant
    Filed: May 21, 2020
    Date of Patent: February 28, 2023
    Assignee: Accenture Global Solutions Limited
    Inventors: Phillip Henry Rogers, Andrew E. Fano, Joshua Neland, Allan Enemark, Tripti Saxena, Jana A. Thompson, David William Vinson
  • Patent number: 11595630
    Abstract: Techniques to facilitate compression of depth data and real-time reconstruction of high-quality light fields. A parameter space of values for a line, pairs of endpoints on different sides of the line, and a palette index for each pixel of a pixel tile of a depth image is sampled. Values for the line, the pairs of endpoints, and the palette index that minimize an error are determined and stored.
    Type: Grant
    Filed: September 23, 2021
    Date of Patent: February 28, 2023
    Assignee: Disney Enterprises, Inc.
    Inventors: Kenneth J. Mitchell, Charalampos Koniaris, Malgorzata E. Kosek, David A. Sinclair
  • Patent number: 11594022
    Abstract: Aspects of the invention include generating a combined raster image from point cloud data and reference data describing an original location of a power line. Selecting a set of candidate pixels from the combined raster image describing an updated location of a power line, wherein the selection is based at least in part on a location of pixels in the combined raster image that describe the original location. Detecting pixels from the set of candidate pixels that describe an updated location of a power line. Modifying the combined raster image to reflect the updated location of the power line.
    Type: Grant
    Filed: November 16, 2020
    Date of Patent: February 28, 2023
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Linsong Chu, Mudhakar Srivatsa, Raghu Kiran Ganti
  • Patent number: 11593654
    Abstract: A method for training a neural network includes receiving a plurality of images and, for each individual image of the plurality of images, generating a training triplet including a subset of the individual image, a subset of a transformed image, and a homography based on the subset of the individual image and the subset of the transformed image. The method also includes, for each individual image, generating, by the neural network, an estimated homography based on the subset of the individual image and the subset of the transformed image, comparing the estimated homography to the homography, and modifying the neural network based on the comparison.
    Type: Grant
    Filed: June 7, 2021
    Date of Patent: February 28, 2023
    Assignee: Magic Leap, Inc.
    Inventors: Daniel DeTone, Tomasz Malisiewicz, Andrew Rabinovich
  • Patent number: 11587261
    Abstract: According to one embodiment, an image processing apparatus includes a buffer and processing circuitry. The buffer stores first and second images capturing an object. The circuitry calculates at least one of a first distance to the object in the first image and a second distance to the object in the second image by using a correction parameter for correcting at least one of influences caused by ambient light, a reflection characteristic of the object, or a color of the object, calculates three-dimensional coordinates of the object on a relative scale by using the first and second images, and calculates three-dimensional coordinates of the object on a real scale based on at least one of the first and second distances, and the three-dimensional coordinates of the object on the relative scale.
    Type: Grant
    Filed: February 26, 2018
    Date of Patent: February 21, 2023
    Assignee: Kabushiki Kaisha Toshiba
    Inventors: Jun Yamaguchi, Yusuke Moriuchi, Nao Mishima
  • Patent number: 11586845
    Abstract: A method for using images that represent time-series data to forecast future images depicting future values as pixelated information is provided. The method includes: receiving a first set of time-series data; converting the received first set of time-series data into a first image; and using the first image to forecast a future image depicting future values as pixelated information that corresponds to a future time interval Training sets of time-series data are used to generate historical data that provides input to a machine learning algorithm, which provides, as an output, a composite image that depicts the future values as pixelated information that reflects associated uncertainties in the value predictions.
    Type: Grant
    Filed: May 29, 2020
    Date of Patent: February 21, 2023
    Assignee: JPMORGAN CHASE BANK, N.A.
    Inventors: Naftali Y. Cohen, Keshav Ramani, Tucker Richard Balch, Maria Manuela Veloso, Srijan Sood, Zhen Zeng
  • Patent number: 11587239
    Abstract: In various embodiments, a map inference application automatically maps a user space. A camera is positioned within the user space. In operation, the map inference application determines a path of a first moving object within the user space based on a tracking dataset generated from images captured by the camera. Subsequently, the map inference application infers a walking space within the user space based on the path. The map inference application then generates a model of at least a portion of the user space based on the walking space. One or more movements of a second object within the user space are based on the model. Advantageously, unlike prior art solutions, the map inference application enables a model of a user space to be automatically and efficiently generated based on images from a single stationary camera.
    Type: Grant
    Filed: March 14, 2019
    Date of Patent: February 21, 2023
    Assignee: Disney Enterprises, Inc.
    Inventors: Elliott Baumbach, Michael Goslin
  • Patent number: 11582615
    Abstract: Disclosed is a 5G or pre-5G communication system for supporting a data transmission rate higher than that of a 4G communication system such as LTE. The present invention relates to a method by which a simulator analyzes a radio wave environment in a wireless communication system, and the method of the present invention comprises the steps of: allowing a simulator to receive geographic information and position information by which a transmitter and a receiver can be positioned in the geographic information; generating, by the transmitter of the simulator arranged at a random position in accordance with the position information, radio waves for at least one direction of a sphere having a fixed radius; grouping into at least one group on the basis of a traveling route of the generated radio waves; setting each group as an operation unit (Warp/Wavefront) for a graphics processing unit (GPU); and analyzing a radio wave environment by using the GPU in which the operation unit is set.
    Type: Grant
    Filed: December 28, 2018
    Date of Patent: February 14, 2023
    Assignees: SAMSUNG ELECTRONICS CO., LTD., INDUSTRY-ACADEMIC COOPERATION FOUNDATION, YONSEI UNIVERSITY
    Inventors: Seungku Han, Won Woo Ro, Byungchul Kim, Myungkuk Yoon, Hyunjin Chung, Youngju Lee
  • Patent number: 11580655
    Abstract: Examples disclosed herein may involve a computing system that is operable to (i) present, via a visual interface, a virtual shape associated with a three-dimensional (3D) coordinate system, (ii) present, via the visual interface, a visual indicator positioned in proximity to the virtual shape and indicating that a specified spatial parameter of the virtual shape will be modified along a specified dimension of the 3D coordinate system in response to a given type of user input associated with the visual indicator, (iii) while presenting the visual indicator, detect an instance of the given type of user input associated with the visual indicator, and (iv) after detecting the instance of the given type of user input, update the virtual shape that is presented via the visual interface by modifying the specified spatial parameter of the virtual shape along the specified dimension.
    Type: Grant
    Filed: June 25, 2020
    Date of Patent: February 14, 2023
    Assignee: WOVEN PLANET NORTH AMERICA, INC.
    Inventors: Tanner Cotant Christensen, Suneet Rajendra Shah, Newton Ko Yue Der, Brandon Huang, Kim Hoang Nguyen
  • Patent number: 11575826
    Abstract: An image processing apparatus comprises an acquisition unit that acquires image data, an estimation unit that detects a predetermined subject from the image data and estimates posture information of the detected subject, and a determination unit that, in a case where a plurality of subjects are detected by the estimation unit, determines a main subject from the plurality of subject using feature vector of each of the subjects obtained from the posture information.
    Type: Grant
    Filed: December 23, 2020
    Date of Patent: February 7, 2023
    Assignee: Canon Kabushiki Kaisha
    Inventor: Ryosuke Tsuji
  • Patent number: 11573325
    Abstract: A method of pose calculation for a portable three-dimensional scanning device including a first sensor and a second sensor the method including utilizing data from the first sensor and data from the second sensor to acquire data defining six degrees of freedom of the scanning device to optimize a first pose calculation, receiving data comprising one of data from the first sensor and data from the second sensor, selecting a subset of the six degrees of freedom of the scanning device, utilizing the data from the first sensor and the received data for the selected subset of six degrees of freedom to optimize a second pose, wherein the unselected degrees of freedom are retained from the first pose and storing received data associated with the second camera pose in a point cloud database.
    Type: Grant
    Filed: January 3, 2020
    Date of Patent: February 7, 2023
    Assignee: Kaarta, Inc.
    Inventors: Steven Huber, Calvin Wade Sheen, Ji Zhang