3-d Or Stereo Imaging Analysis Patents (Class 382/154)
  • Patent number: 11030730
    Abstract: A method and device for generating a composite group image from subgroup images is provided. Subgroup images, each having a common background, are accessed. The boundaries of a subgroup area within each of the subgroup images is determined. At least one horizontal and at least one vertical shift factor is determined using the determined boundaries. An arrangement for the subgroup images based on the at least one horizontal and the at least one vertical shift factor is generated. The composite group image is generated by blending the subgroup images arranged in the arrangement.
    Type: Grant
    Filed: April 2, 2019
    Date of Patent: June 8, 2021
    Assignee: Shutterfly, LLC
    Inventor: Keith A. Benson
  • Patent number: 11030237
    Abstract: Disclosed are methods and apparatuses to recognize actors during normal system operation. The method includes defining actor input such as hand gestures, executing and detecting input, and identifying salient features of the actor therein. A model is defined from salient features, and a data set of salient features and/or model are retained, and may be used to identify actors for other inputs. A command such as “unlock” may be executed in response to actor input. Parameters may be applied to further define where, when, how, etc. actor input is executed, such as defining a region for a gesture. The apparatus includes a processor and sensor, the processor defining actor input, identifying salient features, defining a model therefrom, and retaining a data set. A display may also be used to show actor input, a defined region, relevant information, and/or an environment. A stylus or other non-human actor may be used.
    Type: Grant
    Filed: May 10, 2019
    Date of Patent: June 8, 2021
    Assignee: Atheer, Inc.
    Inventors: Sleiman Itani, Allen Yang Yang
  • Patent number: 11030495
    Abstract: The invention provides the techniques and systems that allow for the identification and classification of objects (i.e., humans) in images using a predictive segmentation model. More specifically, human forms are identified within an image by generating pixel-level bounding boxes for each possible object and using offsets and segmentation masking. In some instances, embodiments of the invention use an identified floor plane that intersects with a bounding box to identify a three-dimensional position for the intersection point, which can then be assigned to the human form and represent its depth within the image.
    Type: Grant
    Filed: June 13, 2019
    Date of Patent: June 8, 2021
    Assignee: Octi
    Inventors: Jacob Richeimer, Justin Fuisz, Lukas Schulte
  • Patent number: 11020091
    Abstract: An ultrasound imaging apparatus may control an ultrasound image in various ways and improve user convenience by controlling a touch screen or display output by the ultrasound imaging apparatus in accordance with a touch pressure or touch time of a user. The ultrasound imaging apparatus may include a probe configured to emit an ultrasonic signal to an object and receive a reflected ultrasonic signal; a processor configured to generate an ultrasound image based on the ultrasonic signal received by the probe; and a touch screen configured to output the ultrasound image generated by the processor and receive a touch of a user or a pressure of the touch, wherein the processor controls the ultrasound image and the touch screen based on the pressure of the touch.
    Type: Grant
    Filed: December 9, 2016
    Date of Patent: June 1, 2021
    Assignee: SAMSUNG MEDISON CO., LTD.
    Inventors: Gil-Ju Jin, Yuri Kim, Mi Jeoung Ahn
  • Patent number: 11024021
    Abstract: A check procedure of a production process of an artifact, wherein 2D and 3D images are acquired from a work area. The images are processed in an analysis check, using neural networks, to extract data that are sent to a check cycle that checks the data in order to inform alarm situations by a signal.
    Type: Grant
    Filed: January 30, 2020
    Date of Patent: June 1, 2021
    Assignee: PRIMECONCEPT S.R.L.
    Inventors: Fabio Borrelli, Paolo Rossi, Sergio Pozzi
  • Patent number: 11022433
    Abstract: A method for reconstructing a surface of a three-dimensional object involves a projection of a laser spot pattern onto the surface of the three-dimensional object by a laser, and a generation of a series of endoscopic images as an endoscope is translated and/or rotated relative to the three-dimensional object. Each endoscopic image illustrates a different view of a laser spot array within the laser spot pattern as projected onto the surface of the three-dimensional object by the laser. The laser spot array may be identical to or a subset of the laser spot pattern. The method further involves a reconstruction of the surface of the three-dimensional object from a correspondence of the different views of the laser spot array as illustrated in the endoscopic images.
    Type: Grant
    Filed: January 14, 2011
    Date of Patent: June 1, 2021
    Assignee: KONINKLIJKE PHILIPS N.V.
    Inventor: Aleksandra Popovic
  • Patent number: 11022432
    Abstract: Disclosed is 3D scanning using a 3D scanner configured for detecting when the scanned object is at rest in the scan volume of the 3D scanner.
    Type: Grant
    Filed: February 14, 2018
    Date of Patent: June 1, 2021
    Assignee: 3SHAPE A/S
    Inventors: Karl-Josef Hollenbeck, Henrik Öjelund, Rasmus Kjær
  • Patent number: 11024076
    Abstract: Techniques for generating an arbitrary view of an asset are disclosed. In some embodiments, arbitrary view generation includes storing a set of images of an asset, wherein each image comprising at least a subset of the set of images has an overlapping field of view with at least one other image in the subset, and generating an image comprising an arbitrary perspective of the asset at least in part by populating the image comprising the arbitrary perspective with pixels harvested from one or more images comprising the set of images.
    Type: Grant
    Filed: November 6, 2018
    Date of Patent: June 1, 2021
    Assignee: Outward, Inc.
    Inventors: Clarence Chui, Manu Parmar
  • Patent number: 11024048
    Abstract: A method, an image processing device, and a system for generating a disparity map are proposed. The method includes the following steps. Images of a specific scene are captured by two image sensors to generate two original images. A shrinking process is performed on the two original images to generate two shrunk images. A shrunk disparity map is generated by using the two shrunk images. A magnifying process is performed on the shrunk disparity map to generate a magnified disparity map. Whether each magnified disparity value of the magnified disparity map is reliable is determined so as to accordingly generate a refined disparity map.
    Type: Grant
    Filed: July 4, 2018
    Date of Patent: June 1, 2021
    Assignee: Wistron Corporation
    Inventors: Chong-Wei Li, Ming-Che Ho
  • Patent number: 11022693
    Abstract: An autonomous vehicle is described herein. The autonomous vehicle includes a lidar sensor system. The autonomous vehicle additionally includes a computing system that executes a lidar segmentation system, wherein the lidar segmentation system is configured to identify objects that are in proximity to the autonomous vehicle based upon output of the lidar sensor system. The computing system further includes a deep neural network (DNN), where the lidar segmentation system identifies the objects in proximity to the autonomous vehicle based upon output of the DNN.
    Type: Grant
    Filed: August 3, 2018
    Date of Patent: June 1, 2021
    Assignee: GM Global Technology Operations LLC
    Inventors: Andrea Allais, Adam Samuel Cadien, Elliot Branson, William Gongshu Xie, Micah Christopher Chambers
  • Patent number: 11025878
    Abstract: An image processing apparatus, which executes image processing for generating a virtual viewpoint image using a plurality of images captured by a plurality of imaging units that image an imaging space from different viewpoints, identifies a specific object among a plurality of objects inside the imaging space, and carries out image processing for generating the virtual viewpoint image on the plurality of objects inside the imaging space. The image processing apparatus executes the image processing on the identified specific object using images captured by more imaging units than in the image processing executed on other objects.
    Type: Grant
    Filed: July 2, 2018
    Date of Patent: June 1, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Yuya Ota
  • Patent number: 11024078
    Abstract: Systems and methods relate to encoded video streams including geometric-data streams transmitted to a receiver for rendering of a viewpoint-adaptive 3D persona. A method includes obtaining at least one triangle-based three-dimensional (3D) submesh of a subject, wherein the obtained triangle-based 3D submesh includes a plurality of submesh vertices that define a plurality of submesh triangles, identifying a plurality of strips of the submesh triangles, generating triangle-strip data representing the identified strips of submesh triangles, generating compressed-submesh data that includes the triangle-strip data, and transmitting the compressed-submesh data to a receiver for reconstruction of the triangle-based 3D submesh of the subject.
    Type: Grant
    Filed: January 8, 2018
    Date of Patent: June 1, 2021
    Assignee: Verizon Patent and Licensing Inc.
    Inventors: Simion Venshtain, Yi Zhang, Cong Nguyen
  • Patent number: 11025890
    Abstract: In embodiments, an electronic device may include a first camera disposed on one surface of the electronic device, a second camera disposed on the one surface, a depth sensor disposed on the one surface, and a processor configured to: cause the first camera to acquire a first one or more images of an external object, and generate depth information of the external object using a selected one of the first camera and second camera or the depth sensor, the selected one based on color information or texture pattern information corresponding to the external object in the first one or more images.
    Type: Grant
    Filed: November 27, 2019
    Date of Patent: June 1, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Songha Choi, Donghoon Kim, Bongchan Kim, Byeonghoon Park
  • Patent number: 11014163
    Abstract: A camera assembly is employed in additive manufacturing to improve the fidelity of a printed object. The camera may scan the surface of a build plate of a 3D printer and an object as it is being printed to generate image data. The image data is processed to detect errors in the build plate or printed object. The printer compensates for the detected errors, which can including modifying the printer configuration and/or modifying the instructions for printing a given object. Using the updated configuration, subsequent objects may then be printed, under a corrected process, to produce an object with fidelity to an original object model.
    Type: Grant
    Filed: April 14, 2017
    Date of Patent: May 25, 2021
    Assignee: Desktop Metal, Inc.
    Inventors: Aaron Preston, Nicholas Mykulowycz
  • Patent number: 11019276
    Abstract: Various embodiments described herein provide implementations for controlling flicker, for example caused by a plurality of light sources, in a multi-sensor environment. Various embodiments provided utilize a broadest illuminator source for capturing image data objects for processing. The broadest illuminator source minimizes the number of activation changes required between the various illuminator sources. One example embodiment includes activating a broadest illuminator source of a plurality of illuminator sources; determining, based on a plurality of image sensors and a sensor activation sequence, a chosen image sensor of the plurality of image sensors for an image processing operation; and activating a chosen illuminator source of the plurality of illuminator sources, the chosen illuminator source associated with the chosen image sensor.
    Type: Grant
    Filed: November 14, 2019
    Date of Patent: May 25, 2021
    Assignee: Hand Held Products, Inc.
    Inventors: Tao Xian, Ka Man Au, Dave M. Wilz, Gennady Germaine, Patrick Anthony Giordano, Erik Van Horn, Michael Vincent Miraglia, Benjamin Hejl, Thomas A. Sweet
  • Patent number: 11019362
    Abstract: Provided are an information processing device and an information processing method that enable suppression of a reduction in coding efficiency while suppressing a reduction in subjective quality. Information regarding a three-dimensional region is encoded on the basis of a distribution related to overlapping of visual fields of the three-dimensional region to be imaged by a plurality of imaging units, the distribution being specified by using a parameter relating to overlapping of visual fields that are imaging ranges of the plurality of imaging units.
    Type: Grant
    Filed: December 14, 2017
    Date of Patent: May 25, 2021
    Assignee: SONY CORPORATION
    Inventor: Masashi Eshima
  • Patent number: 11017546
    Abstract: A depth detection device includes a stereo image recording device, a scaler and a depth determiner is provided. The stereo image recording device is configured to record a stereo image of a scene, and includes a first optical path for recording a first image of the stereo image, and a second optical path for recording a second image of the stereo image. The first optical path and the second optical path have different lengths. The scaler determines a scaling of the first image or of the second image, by minimizing differing lateral magnification of objects in the scene, and for performing the scaling. The depth determiner determines a depth map of the scene based upon the scaled stereo image.
    Type: Grant
    Filed: April 23, 2019
    Date of Patent: May 25, 2021
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Hector Navarro Fructuoso, Manuel Martinez Corral, Genaro Saavedra Tortosa, Jorge Sola Pikabea, Juan Carlos Barreiro Hervas, Seokmin Hong
  • Patent number: 11016613
    Abstract: An image recognition device, an image recognition method and an image recognition unit capable of performing touch recognition high in accuracy. The image recognition device includes a pattern display section adapted to display a first pattern in which bright lines are arranged with a first pitch, and a second pattern in which bright lines are arranged with a second pitch at respective time points different from each other, a measurement point determination section adapted to detect a finger located between a camera and a screen, and determine a fingertip of the finger, and a position detection section adapted to detect the position of the fingertip with respect to the screen based on an image including the first pattern and an image including the second pattern obtained by the camera.
    Type: Grant
    Filed: January 10, 2017
    Date of Patent: May 25, 2021
    Assignee: SEIKO EPSON CORPORATION
    Inventor: Taisuke Yamauchi
  • Patent number: 11012676
    Abstract: Methods, systems, and media for generating and rendering immersive video content are provided. In some embodiments, the method comprises: receiving information indicating positions of cameras in a plurality of cameras; generating a mesh on which video content is to be projected based on the positions of the cameras in the plurality of cameras, wherein the mesh is comprised of a portion of a faceted cylinder, and wherein the faceted cylinder has a plurality of facets each corresponding to a projection from a camera in the plurality of cameras; receiving video content corresponding to the plurality of cameras; and transmitting the video content and the generated mesh to a user device in response to receiving a request for the video content from the user device.
    Type: Grant
    Filed: December 13, 2017
    Date of Patent: May 18, 2021
    Assignee: Google LLC
    Inventor: Samuel Kvaalen
  • Patent number: 11010909
    Abstract: Provided is a road surface information-based imaging environment evaluation method, an imaging environment evaluation device, an imaging environment evaluation system, and a storage medium. The imaging environment evaluation method includes: acquiring a disparity information matrix and pixel coordinates of a vanishing point in the disparity information matrix; subjecting the disparity information matrix to matrix partition and projection in accordance with the pixel coordinates of the vanishing point so as to acquire a disparity projection image; acquiring a road surface model-based statistic model in accordance with the disparity projection image; and acquiring an evaluation result of a current imaging environment in accordance with a relationship between the statistic model and a predetermined threshold.
    Type: Grant
    Filed: December 19, 2019
    Date of Patent: May 18, 2021
    Assignee: Beijing Smarter Eye Technology Co. Ltd.
    Inventors: Qiwei Xie, Zhao Sun, Yongcai Liu, Feng Cui, Haitao Zhu
  • Patent number: 11010915
    Abstract: Three-dimensional (3D) depth imaging systems and methods are disclosed for dynamic container auto-configuration. A 3D-depth camera captures 3D image data of a shipping container located in a predefined search space during a shipping container loading session. An auto-configuration application determines a representative container point cloud and (a) loads an initial pre-configuration file that defines a digital bounding box having dimensions representative of the predefined search space and an initial front board area; (b) applies the digital bounding box to the container point cloud to remove front board interference data from the container point cloud based on the initial front board area; (c) generates a refined front board area based on the shipping container type; (d) generates an adjusted digital bounding box based on the refined front board area; and (e) generates an auto-configuration result comprising the adjusted digital bounding box containing at least a portion of the container point cloud.
    Type: Grant
    Filed: July 11, 2019
    Date of Patent: May 18, 2021
    Assignee: Zebra Technologies Corporation
    Inventors: Lichen Wang, Yan Zhang, Kevin J. O'Connell
  • Patent number: 11010634
    Abstract: An apparatus includes a processor that matches of local-feature-amounts in a state where an image of a measurement target captured by an image-sensor and a projective-transformed image of three-dimensional design data of the measurement target substantially overlap each other on a display to search the captured image and a virtual image generated from the projective-transformed image for a plurality of feature-point pairs with similar local-feature-amounts of an image, estimates a temporary-external-parameter related to a position and orientation of the image-sensor, compares an initial-external-parameter and the temporary-external-parameter to diagnose reliability of the temporary-external-parameter, and selects, among the feature-point pairs, a specified number of feature-point pairs with a score value indicating similarity between two feature-points forming each feature-point pair equal to or higher than a threshold value, estimate a final-external-parameter using the selected feature-point pairs, and disp
    Type: Grant
    Filed: July 8, 2019
    Date of Patent: May 18, 2021
    Assignee: FUJITSU LIMITED
    Inventors: Fumiyuki Takahashi, Tetsuo Koezuka
  • Patent number: 11010630
    Abstract: A computer-implemented method for detecting landmark pairs in a pair of images is provided. The method includes receiving a pair of images, sampling the pair of images to generate reduced-resolution pairs of images, identifying features in the reduced-resolution pairs of images, matching the features in the image pairs, using the matched features in an increased resolution pair of images as guides for feature matching, and through iteratively guiding feature matching, identifying landmarks in the full-resolution pair of images.
    Type: Grant
    Filed: April 27, 2018
    Date of Patent: May 18, 2021
    Assignees: Washington University, The Curators of The University of Missouri
    Inventors: Deshan Yang, Ye Duan
  • Patent number: 11010615
    Abstract: In one embodiment, a method includes receiving autonomous-vehicle sensor data from a sensor array of an autonomous vehicle. The autonomous-vehicle sensor data indicates an object in an external environment of the autonomous vehicle. The method further includes determining a confidence score for a classification of the object. The method further includes determining an object graphic with a level of detail to visually represent the object. The level of detail of the object graphic is based on the confidence score. The method further includes providing for display a visual representation the object graphic.
    Type: Grant
    Filed: November 14, 2017
    Date of Patent: May 18, 2021
    Assignee: Lyft, Inc.
    Inventors: Robert Earl Rasmusson, Jr., Taggart Matthiesen, Craig Dehner, Linda Dong, Frank Taehyun Yoo, Karina van Schaardenburg, John Tighe, Matt Vitelli, Jisi Guo, Eli Guerron
  • Patent number: 11004221
    Abstract: A depth recovery method includes: performing feature extraction on a monocular image to obtain a feature image of the monocular image; decoupling the feature image to obtain a scene structure graph of the feature image; performing gradient sensing on the feature image and the scene structure graph to obtain a region-enhanced feature image; and performing depth estimation according to the region-enhanced feature image to obtain a depth image of the monocular image.
    Type: Grant
    Filed: December 21, 2019
    Date of Patent: May 11, 2021
    Assignee: ZHEJIANG SENSETIME TECHNOLOGY DEVELOPMENT CO., LTD.
    Inventors: Hujun Bao, Guofeng Zhang, Qinhong Jiang, Jianping Shi
  • Patent number: 11004235
    Abstract: Embodiments of the present disclosure provide a method and apparatus for determining position and orientation of a bucket of an excavator, an electronic device and a computer readable medium. The method may include: acquiring an image of a bucket of an excavator collected by a camera provided on an excavator body, the image of the bucket including a preset marker provided on the bucket; determining position and orientation information of the camera relative to the bucket on the basis of the image of the bucket and pre-acquired three-dimensional feature information of the preset marker; and converting the position and orientation information of the camera relative to the bucket into position and orientation information of the bucket relative to the excavator body.
    Type: Grant
    Filed: November 6, 2019
    Date of Patent: May 11, 2021
    Assignee: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
    Inventors: Xinjing Cheng, Ruigang Yang, Feixiang Lu, Yajue Yang, Hao Xu
  • Patent number: 11004234
    Abstract: The present application discloses a method and apparatus for annotating point cloud data. A specific implementation of the method includes: collecting data in a given scenario by using a laser radar and a non-laser radar sensor to respectively obtain point cloud data and sensor data; segmenting and tracking the point cloud data to obtain point cloud segmentation and tracking results; recognizing and tracking feature objects in the sensor data to obtain feature object recognition and tracking results; correcting the point cloud segmentation and tracking results by using the feature object recognition and tracking results, to obtain confidence levels of the point cloud recognition and tracking results; and determining a point cloud segmentation and tracking result whose confidence level is greater than a confidence level threshold as a point cloud annotation result. This implementation reduces the amount of manual work required for annotating point cloud data, thereby reducing the annotation costs.
    Type: Grant
    Filed: January 19, 2017
    Date of Patent: May 11, 2021
    Assignee: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
    Inventors: Jun Zhan, Houchang Lv, Xu Han
  • Patent number: 11004229
    Abstract: An image measurement device is provided that includes at least one processor and at least one memory functioning as: a first acquisition unit that acquires a plurality of image data captured at a plurality of focus positions and at different viewpoints; a second acquisition unit that acquires distance information corresponding to each of the plurality of image data on the basis of the image data at different viewpoints at each focus position; a designation unit that designates a ranging point; a determination unit that determines reliability corresponding to the ranging point in each of the plurality of image data; and a selection unit that selects the distance information used as the distance information of the ranging point from the distance information acquired by the second acquisition unit on the basis of the reliability determined by the determination unit.
    Type: Grant
    Filed: September 21, 2018
    Date of Patent: May 11, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Takuya Ishibashi
  • Patent number: 11006092
    Abstract: An apparatus for enhancing stereoscopic imaging include a light projector, a stereo camera and a control circuit. The light projector may be configured to project a pattern of light in a direction. The pattern may include (i) a background pattern that illuminates an area along the direction and (ii) a textured pattern that varies an intensity of the light in the area. The stereo camera may be configured to generate two sequences of synchronized images by imaging the area. The control circuit may be configured to (i) control power to the light projector, (ii) receive the two sequences of synchronized images from the stereo camera and (iii) generate one or more output signals in response to the two sequences of synchronized images.
    Type: Grant
    Filed: June 11, 2019
    Date of Patent: May 11, 2021
    Assignee: Ambarella International LP
    Inventors: Paolo Grisleri, Omar Pighi, Gabriele Camellini, Iari Gabriel Marino
  • Patent number: 11004250
    Abstract: A point cloud data display system includes a target unit including a reflection target, a scanner device configured to acquire point cloud data, a surveying instrument configured to obtain a distance and an angle to the reflection target, measured coordinates and a direction angle of the scanner device, and a display device configured to display data output from the scanner device and the surveying instrument. The scanner device outputs point cloud data in association with an observation point each time of acquisition of the point cloud data. The surveying instrument outputs coordinates, a direction angle of the scanner device at the observation point. When the point cloud data, coordinates and direction angle with respect to the observation point are obtained, the display device converts point cloud data into data in a map coordinate system and displays the converted data on a display unit in association with a map.
    Type: Grant
    Filed: September 17, 2019
    Date of Patent: May 11, 2021
    Assignee: TOPCON CORPORATION
    Inventors: Satoshi Yasutomi, Takahiro Komeichi
  • Patent number: 11004266
    Abstract: The present invention relates to an articulated model registration method and apparatus which three-dimensionally restore an articulated model of a body, such as a hand, an upper body, and a whole body, from an image and to acquire a two-dimensional landmark from a two-dimensional image to generate and estimate a three-dimensional articulated model corresponding thereto.
    Type: Grant
    Filed: December 21, 2018
    Date of Patent: May 11, 2021
    Assignee: ALCHERA INC.
    Inventors: Jung Woo Chang, Young Kyoo Hwang, Jung Bae Kim
  • Patent number: 11006089
    Abstract: An apparatus comprises: an identification unit configured to identify an object position and/or an occurrence position of an event in an image capturing region; a selection unit configured to select, based on an identified position, one or more sets of cameras among a plurality of sets of cameras associated respectively with a plurality of specific positions in the image capturing region, wherein a set of cameras among the plurality of sets of cameras includes a plurality of cameras for capturing, respectively form different directions, a specific position associated with the set of cameras; an acquisition unit configured to acquire information indicating a position and a direction of a virtual viewpoint; and a generation unit configured to generate a virtual viewpoint image according to the indicated virtual viewpoint.
    Type: Grant
    Filed: March 6, 2019
    Date of Patent: May 11, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Tomoaki Arai
  • Patent number: 10999562
    Abstract: On the basis of a first imaging signal corresponding to a first viewpoint and including white pixels and color component pixels and a second imaging signal corresponding to a second viewpoint different from the first viewpoint and including fewer white pixels than the first imaging signal to increase a rate of the color component pixels in the second imaging signal, a parallax detecting section detects a parallax of the second viewpoint with respect to the first viewpoint. A parallax compensating section performs parallax compensation for the imaging signal for the second viewpoint on the basis of the detected parallax to generate a parallax-compensated color difference signal for the first viewpoint. A fallback determining section and a signal selecting section selects a parallax-compensated second color difference signal or a color difference signal for the first viewpoint to obtain a high-sensitivity captured image while suppressing degradation of the image quality performance.
    Type: Grant
    Filed: January 11, 2018
    Date of Patent: May 4, 2021
    Assignee: SONY CORPORATION
    Inventors: Masatoshi Yokokawa, Masashi Uchida, Takahiro Nagano
  • Patent number: 10997761
    Abstract: The present invention relates to systems and methods suitable for creating and delivering augmented reality (AR) content. In particular, the present invention relates to systems and methods to create portable AR content to be downloaded, rendered, and displayed on a display device in real-time.
    Type: Grant
    Filed: November 20, 2018
    Date of Patent: May 4, 2021
    Assignee: ImagineAR Inc.
    Inventor: Rodney Guzman
  • Patent number: 10999498
    Abstract: The present disclosure relates to an image processing apparatus and an image processing method that make it possible to generate a high picture quality texture image of a predetermined viewpoint using an omnidirectional image. A reception section receives a texture image and a depth image as well as a guide image to be referred to upon generation of a display image in which the texture image and the depth image are used. A drawing section compares a pixel value of the display image generated using the texture image and the depth image and a corresponding pixel value of the guide image with each other and executes a process for changing the pixel value in response to a result of the comparison. The present disclosure can be applied, for example, to a home server or the like that generates a display image of a predetermined viewpoint from an omnidirectional image.
    Type: Grant
    Filed: July 14, 2017
    Date of Patent: May 4, 2021
    Assignee: Sony Corporation
    Inventors: Tetsuya Kikukawa, Junichi Tanaka
  • Patent number: 10996452
    Abstract: A method and microscope for high-resolution 2D scanning microscopy of a sample, wherein the sample is illuminated with illumination radiation in such a way that the illumination radiation is focused in or on the sample to form a diffraction-limited illumination spot at a point. The point is imaged in a diffraction-limited manner into a diffraction image on a spatially resolving surface detector, wherein the surface detector has a spatial resolution that resolves a diffraction structure of the diffraction image. Neither an imaging point spread function nor an illumination point spread function is manipulated for producing an asymmetry. The point is displaced relative to the sample into different scanning positions. A 2D image of the sample is produced from the data of the surface detector and from the scanning positions assigned to said data. The 2D image has a resolution that is increased beyond a resolution limit for imaging.
    Type: Grant
    Filed: September 13, 2018
    Date of Patent: May 4, 2021
    Assignee: Carl Zeiss Microscopy GmbH
    Inventors: Ingo Kleppe, Yauheni Novikau
  • Patent number: 10991133
    Abstract: To reduce complexity and corresponding run time, quantum computation is used for rendering a volume. The quantum computation may search for voxels along a ray or the minimum or maximum. The quantum computation may orient (e.g., rotate) data for more efficient searching for the maximum or minimum. Due to the superposition in quantum computing, the efficiency in volume rendering medical images is increased as compared to traditional binary approaches.
    Type: Grant
    Filed: January 25, 2019
    Date of Patent: April 27, 2021
    Assignee: Siemens Healthcare GmbH
    Inventors: Lining Yang, Christoph Vetter, Feng Qiu
  • Patent number: 10991130
    Abstract: An exemplary system includes a memory that stores instructions and a processor communicatively coupled to the memory. The processor is configured to execute the instructions to access a thermal image captured by a thermal imaging device, the thermal image including a plurality of pixels, convert the thermal image to a heatmap image, generate a foreground image by separating a background represented in the heatmap image from a foreground represented in the heatmap image, identify, in the foreground image, at least one hotspot representing a heat source located at the user premises, determine a contour shape of the at least one hotspot, and determine, based on the contour shape of the at least one hotspot, whether the at least one hotspot represented in the foreground image represents a target heat source located at the user premises.
    Type: Grant
    Filed: July 29, 2019
    Date of Patent: April 27, 2021
    Assignee: Verizon Patent and Licensing inc.
    Inventors: Vaidyanathan Kalyanasundaram, Rajaraman Vaidyanathaswami, Ashish Phutela, Venkata Sai Karun Gollapalli, Obulivijayaraj Obuli, Jayaraman J. Arumugam, Anil Kumar
  • Patent number: 10991340
    Abstract: The present disclosure relates to an image processing apparatus and an image processing method capable of realizing grasping of a state of a projected image at a lower cost. A difference between discontinuous frames of a captured image configured with a plurality of frames obtained by capturing a projected image which is obtained by sequentially projecting predetermined pattern images opposite in sign, which are positive and negative pattern images, at a higher frame rate than a frame rate of the projected image by a rolling shutter scheme is calculated. The present disclosure can be applied to, for example, an image processing apparatus, a projection apparatus, an imaging apparatus, a projection imaging apparatus, a controller, a projection imaging system, or the like.
    Type: Grant
    Filed: August 10, 2017
    Date of Patent: April 27, 2021
    Assignee: SONY CORPORATION
    Inventor: Masuyoshi Kurokawa
  • Patent number: 10991157
    Abstract: Disclosed herein are a method and apparatus for matching 3D terrain information based on aerial images captured at different altitudes.
    Type: Grant
    Filed: October 25, 2019
    Date of Patent: April 27, 2021
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Jung-Jae Yu, Kyung-Kyu Kang, Hye-Sun Kim, Chang-Joon Park, Yun-Ji Ban, Dong-Wan Ryoo, Man-Hee Lee, Chang-Woo Chu
  • Patent number: 10992947
    Abstract: Method and devices for coding point cloud data using a planar coding mode. The planar coding mode may be signaled using in a planar mode flag to signal that a volume is planar. A planar volume has all of its occupied child nodes on one side of a plane bisecting the volume. A planar position flag may signal which side of the volume is occupied. Planarity may be determined and signaled with respect to a horizontal plane, vertical plane, or otherwise. Occupancy bits may be inferred as a result of planar coding mode signaling.
    Type: Grant
    Filed: June 28, 2019
    Date of Patent: April 27, 2021
    Assignee: BlackBerry Limited
    Inventors: Sébastien Lasserre, David Flynn
  • Patent number: 10989816
    Abstract: Systems, computer-implemented methods, apparatus and/or computer program products are provided that facilitate improving the accuracy of global positioning system (GPS) coordinates of indoor photos. The disclosed subject matter further provides systems, computer-implemented methods, apparatus and/or computer program products that facilitate generating exterior photos of structures based on GPS coordinates of indoor photos.
    Type: Grant
    Filed: February 8, 2019
    Date of Patent: April 27, 2021
    Assignee: Matterport, Inc.
    Inventors: Gunnar Hovden, Scott Adams
  • Patent number: 10990105
    Abstract: A vehicle can include an on-board data processing system that receives sensor data captured by various sensors of the vehicle. As a vehicle travels along a route, the on-board data processing system can process the captured sensor data to identify a potential vehicle stop. The on-board data processing system can then identify geographical coordinates of the location at which the potential vehicle stop occurred, use artificial intelligence to classify a situation of the vehicle at the potential stop, and determine whether the stop was caused by an unmarked intersection or a location at which vehicles typically yield to oncoming traffic using the classification and/or map data. If the stop was caused by an unmarked intersection or a yielding maneuver, the on-board data processing system can generate virtual stop or yield line data corresponding to the identified geographic coordinates and transmit this data to a server over a network for processing.
    Type: Grant
    Filed: December 28, 2018
    Date of Patent: April 27, 2021
    Assignee: Beijing Voyager Technology Co., Ltd.
    Inventor: Qi Chen
  • Patent number: 10984555
    Abstract: An object detection device, detecting an object based on an image from a stereo camera on a vehicle, includes a parallax calculator, a first road parameter estimator, a road parameter storage, a second road parameter estimator, and an object detector. The parallax calculator calculates three-dimensional information of a scene in the image. The first road parameter estimator calculates a first road parameter based on the three-dimensional information. The road parameter storage associates the first road parameter with vehicle information to store therein. The second road parameter estimator calculates, based on stored information, a second road parameter using the first road parameter under a predetermined condition for the vehicle. The object detector detects the object using the second road parameter. The predetermined condition includes that an angular difference between a road surface observed from the stereo camera and a contact surface of the vehicle at observation is within a predetermined angle.
    Type: Grant
    Filed: March 30, 2017
    Date of Patent: April 20, 2021
    Assignee: MITSUBISHI ELECTRIC CORPORATION
    Inventor: Shintaro Watanabe
  • Patent number: 10984703
    Abstract: To provide a semiconductor device or display system. To provide a semiconductor device or display system that can display stereoscopic images. A signal generation unit has a function of, with the use of artificial intelligence, obtaining information on a scene of an image and information on a depth of the image and correcting image data on the basis of the information so that a stereoscopic effect is emphasized. An image signal obtained by the correction of the image data is supplied to a display unit, so that a stereoscopic image can be displayed on a display region.
    Type: Grant
    Filed: March 13, 2018
    Date of Patent: April 20, 2021
    Assignee: Semiconductor Energy Laboratory Co., Ltd.
    Inventors: Yuji Iwaki, Shunpei Yamazaki
  • Patent number: 10986676
    Abstract: A wireless communication apparatus includes a transmission unit, a transmission controller, and an acceptance unit. The transmission unit transmits an identifier of a network to which the wireless communication apparatus belongs, without designating a destination. The transmission controller controls the transmission unit such that the identifier is presented in a different manner on a terminal that has received the identifier if movement of a person detected around the wireless communication apparatus is predetermined movement. The acceptance unit accepts a connection request using the identifier from the terminal.
    Type: Grant
    Filed: October 19, 2017
    Date of Patent: April 20, 2021
    Assignee: FUJI XEROX CO., LTD.
    Inventor: Osamu Igarashi
  • Patent number: 10986326
    Abstract: A system and methods for a CODEC driving a real-time light field display for multi-dimensional video streaming, interactive gaming and other light field display applications is provided applying a layered scene decomposition strategy. Multi-dimensional scene data including information on directions of normals is divided into a plurality of data layers of increasing depths as the distance between a given layer and the display surface increases. Data layers which are sampled using a plenoptic sampling scheme and rendered using hybrid rendering, such as perspective and oblique rendering, to encode light fields corresponding to each data layer. The resulting compressed, (layered) core representation of the multi-dimensional scene data is produced at predictable rates, reconstructed and merged at the light field display in real-time by applying view synthesis protocols, including edge adaptive interpolation, to reconstruct pixel arrays in stages (e.g. columns then rows) from reference elemental images.
    Type: Grant
    Filed: February 21, 2020
    Date of Patent: April 20, 2021
    Inventors: Matthew Hamilton, Chuck Rumbolt, Donovan Benoit, Matthew Troke, Robert Lockyer, Thomas Butyn
  • Patent number: 10984552
    Abstract: An approach is provided for automatically recommending ground control points or any other feature points for image correction (e.g., satellite image correction). The approach, for example, involves collecting a plurality of images depicting a geographic area of interest. The approach also involves processing the plurality of images to detect one or more candidate feature points (e.g., ground control points or other features detectable in the images). The approach further involves performing a feature correspondence of the one or more candidate feature points across the plurality of images. The approach also involves triangulating respective locations of the one or more candidate feature points based on the feature correspondence. The approach further involves filtering the one or more candidate feature points based on the respective locations. The approach further involves providing the filtered one or more candidate feature points as an output comprising one or more recommended feature points.
    Type: Grant
    Filed: July 26, 2019
    Date of Patent: April 20, 2021
    Assignee: HERE Global B.V.
    Inventors: David Johnston Lawlor, Anish Mittal, Zhanwei Chen
  • Patent number: 10984540
    Abstract: A method of LiDAR-based vehicle tracking for a non-transitory computer readable storage medium storing one or more programs is disclosed. The one or more programs include instructions, which when executed by a computing device, cause the computing device to perform the following steps including taking point clusters that belong to vehicles in a single LiDAR frame as input, tracking each vehicle as a probabilistic distribution, assigning each tracked vehicle to a corresponding one of the point clusters, and recalculating the probabilistic distribution of each tracked vehicle.
    Type: Grant
    Filed: October 15, 2018
    Date of Patent: April 20, 2021
    Assignee: TUSIMPLE, INC.
    Inventors: Xue Mei, Chenyang Li
  • Patent number: 10977814
    Abstract: Embodiments described herein relate to systems and methods for specular surface inspection, and particularly to systems and methods for surface inspection comprising inverse synthetic aperture imaging (“ISAI”) and specular surface geometry imaging (“SSGI”). Embodiments may allow an object under inspection, to be observed, imaged and processed while continuing to be in motion. Further, multiple optical input sources may be provided, such that the object does not have to be in full view of all optical sensors at once. Further, multi-stage surface inspection may be provided, wherein an object under inspection may be inspected at multiple stages of an inspection system, such as, for an automotive painting process, inspection at primer, inspection at paint, inspection at final assembly. SSGI imaging modules are also described for carrying out micro-deflectometry.
    Type: Grant
    Filed: January 4, 2019
    Date of Patent: April 13, 2021
    Assignee: Sightline Innovation Inc.
    Inventors: Wallace Trenholm, Maithili Mavinkurve, Mark Alexiuk, Jason Cassidy