Three-dimension Patents (Class 345/419)
  • Patent number: 11017581
    Abstract: Accelerating structure for hybrid ray tracing is characterized by high locality, wherein scene changes are updated locally in one of its hierarchies, without effecting other locations in the structure. Reconstructions of accelerating structures of prior art are replaced by low-cost updates. The efficiency of traversals is improved by a double step traversal.
    Type: Grant
    Filed: April 9, 2020
    Date of Patent: May 25, 2021
    Assignee: ADSHIR LTD.
    Inventors: Reuven Bakalash, Ron Weitzman
  • Patent number: 11012531
    Abstract: Systems, methods, devices, and non-transitory media of various embodiments enable culling requests for hierarchical level of detail (HLOD) content over a communications network. Various embodiment methods may reduce a number of requests associated with dynamic camera movement, compared to number of requests generated in current methods.
    Type: Grant
    Filed: April 16, 2020
    Date of Patent: May 18, 2021
    Assignee: Cesium GS, Inc.
    Inventors: Joshua Lawrence, Omar Shehata, Sean Lilley, Patrick Cozzi
  • Patent number: 11011077
    Abstract: A virtual reality system providing a virtual robotic surgical environment, and methods for using the virtual reality system, are described herein. Within the virtual reality system, various user modes enable different kinds of interactions between a user and the virtual robotic surgical environment. For example, one variation of a method for facilitating navigation of a virtual robotic surgical environment includes displaying a first-person perspective view of the virtual robotic surgical environment from a first vantage point, displaying a first window view of the virtual robotic surgical environment from a second vantage point and displaying a second window view of the virtual robotic surgical environment from a third vantage point. Additionally, in response to a user input associating the first and second window views, a trajectory between the second and third vantage points can be generated sequentially linking the first and second window views.
    Type: Grant
    Filed: June 26, 2018
    Date of Patent: May 18, 2021
    Assignee: VERB SURGICAL INC.
    Inventors: Pablo Eduardo Garcia Kilroy, Eric Mark Johnson, Bernard Fai Kin Siu, Haoran Yu
  • Patent number: 11010016
    Abstract: The disclosed technology is generally directed to mixed reality devices. In one example of the technology, a mixed-reality view is provided to an operator. The mixed-reality view includes both a real-world environment of the operator and holographic aspects. The holographic aspects include at least a first hologram. The first hologram is displayed with a first hologram menu, such that the first hologram menu includes visible selectable menu options associated with the first hologram. In the mixed-reality view, the first hologram menu, including the visible selectable menu options of the first hologram menu, is rotated to face the operator as the operator moves, such that the first hologram menu rotates in a curved manner about the first hologram as the first hologram menu rotates. Responsive to the operator making a selection on the first hologram menu, the first hologram in the mixed-reality view is altered based on the selection.
    Type: Grant
    Filed: May 7, 2020
    Date of Patent: May 18, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Victor Jia, Kevin Thomas Mather, Robert István Butterworth, Kyle Mouritsen
  • Patent number: 11007426
    Abstract: Provided is a game client control method and apparatus, a storage medium, and an electronic apparatus. The method including obtaining first orientation data detected by a target detection apparatus, a game client being installed on a mobile terminal, the target detection apparatus being disposed in the mobile terminal, a game screen of the game client being at a first angle of view according to the first orientation data, and the first orientation data comprising a first orientation of the mobile terminal, obtaining second orientation data detected by the target detection apparatus, the second orientation data including a second orientation of the mobile terminal, and switching the game screen from the game screen at the first angle of view to a game screen at a second angle of view based on relative orientation data between the second orientation data and the first orientation data satisfying a target condition.
    Type: Grant
    Filed: September 17, 2019
    Date of Patent: May 18, 2021
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LTD
    Inventor: Tian Hao Tian
  • Patent number: 11007017
    Abstract: Methods and systems for registering a manipulator assembly and independently positionable surgical table are provided herein. In one aspect, methods include reading a fiducial marker on the surgical table with a sensor associated with the manipulator assembly and localizing the manipulator assembly and surgical table with respect to a common reference frame. Methods may further include translating a 3D configuration of the surgical table to a 2D frame of reference so as to estimate a 3D pose of the surgical table relative the manipulator assembly for use in coordinating movements therebetween.
    Type: Grant
    Filed: March 4, 2019
    Date of Patent: May 18, 2021
    Assignee: INTUITIVE SURGICAL OPERATIONS, INC.
    Inventors: Patrick O'Grady, Tao Zhao, Christopher R. Burns, Jason Hemphill, Brian D. Hoffman, Simon P. Dimaio, Rodney Vance
  • Patent number: 11010977
    Abstract: A method includes: detecting an object in a first image; receiving a selection of the object depicted in the image; associating the object with a second device based on the selection; and, in response to the selection: recording a series of odometry data; estimating a location of the first device based on the odometry data; recording a series of images; estimating a location of the second device based on the images; calculating a first reference vector in the reference frame of the first device defining the location of the second device relative to the location of the first device; receiving, from the second device, a second reference vector; calculating a rotation and an offset between the reference vectors; and transforming the reference frame of the first device to a common reference based on the rotation and the offset.
    Type: Grant
    Filed: May 30, 2019
    Date of Patent: May 18, 2021
    Assignee: Jido, Inc.
    Inventors: Mark Stauber, Jaeyong Sung, Amichai Levy
  • Patent number: 11010513
    Abstract: A computer-implemented method of preventing computationally explosive calculations. The method includes obtaining, by a processor of the computer, measured data of one of a physical process or a physical object; performing hierarchical numerical modeling of a physical process inclusive of an Earth model containing at least one of (a) infrastructure in the ground and (b) a formation feature in the ground, wherein predicted data is generated; comparing the measured data to the predicted data to calculate an estimated error; analyzing the estimated error via an inversion process to update the at least one of the Earth model and infrastructure model so as to reduce the estimated error and to determine a final composite Earth model of at least one of the infrastructure and the feature; and using the final composite Earth model to characterize at least one of the process and the physical object.
    Type: Grant
    Filed: January 15, 2018
    Date of Patent: May 18, 2021
    Assignee: National Technology & Engineering Solutions of Sandia, LLC
    Inventor: Chester J. Weiss
  • Patent number: 11010956
    Abstract: Foveated rendering for rendering an image uses a ray tracing technique to process graphics data for a region of interest of the image, and a rasterisation technique is used to process graphics data for other regions of the image. A rendered image can be formed using the processed graphics data for the region of interest of the image and the processed graphics data for the other regions of the image. The region of interest may correspond to a foveal region of the image. Ray tracing naturally provides high detail and photo-realistic rendering, which human vision is particularly sensitive to in the foveal region; whereas rasterisation techniques are suited for providing temporal smoothing and anti-aliasing in a simple manner, and is therefore suited for use in the regions of the image that a user will see in the periphery of their vision.
    Type: Grant
    Filed: December 8, 2016
    Date of Patent: May 18, 2021
    Assignee: Imagination Technologies Limited
    Inventors: Steven Blackmon, Luke T. Peterson, Cuneyt Ozdas, Steven J. Clohset
  • Patent number: 11010952
    Abstract: A representation of a surface of one or more objects is positioned in a virtual space is obtained in a computer animation system. Thereafter, a guide curve specification of a guide curve in the virtual space relative to the surface is received. Thereafter, the computer animation system computes a first set of tangent vector values for differentiable locations along the guide curve and computes a second set of tangent vector values for nondifferentiable locations along the guide curve. Using the first set and second set, the computer animation system computes a third set of tangent vector values for locations on the surface other than locations along the guide curve and computes a tangent vector field over the surface from at least the first set of tangent vector values, the second set of tangent vector values, and the third set of tangent vector values.
    Type: Grant
    Filed: January 29, 2021
    Date of Patent: May 18, 2021
    Assignee: Weta Digital Limited
    Inventor: Kevin Atkinson
  • Patent number: 11010970
    Abstract: Systems and methods according to various embodiments enable a user to view three-dimensional representations of data objects (“nodes”) within a 3D environment from a first person perspective. The system may be configured to allow the user to interact with the nodes by moving a virtual camera through the 3D environment. The nodes may have one or more attributes that may correspond, respectively, to particular static or dynamic values within the data object's data fields. The attributes may include physical aspects of the nodes, such as color, size, or shape. The system may group related data objects within the 3D environment into clusters that are demarked using one or more cluster designators, which may be in the form of a dome or similar feature that encompasses the related data objects. The system may enable multiple users to access the 3D environment simultaneously, or to record their interactions with the 3D environment.
    Type: Grant
    Filed: July 29, 2019
    Date of Patent: May 18, 2021
    Assignee: SPLUNK INC.
    Inventors: Roy Arsan, Alexander Raitz, Clark Allan, Cary Glen Noel
  • Patent number: 11003683
    Abstract: Disclosed are methods and systems that help to visualize large groups of documents in a virtual reality or augmented reality environment comprising a three-dimensional (3D) space. An example method involves a computing device: determining a group of elements based at least in part on the one or more input parameters; determining one or more attributes based at least in part on the one or more parameters, the group of elements, or both; determining, for each element from the group, a respective location in a 3D space, based on one or more of the attributes; displaying a 3D graphical environment representing the 3D space, wherein each element from the group is represented in the 3D graphical environment by a graphic object at its respectively determined location in the 3D space; and enabling user interaction with the graphic objects in the 3D graphical environment.
    Type: Grant
    Filed: February 14, 2018
    Date of Patent: May 11, 2021
    Assignee: THE REGENTS OF THE UNIVERSITY OF CALIFORNIA
    Inventors: Lee Fleming, Guan-Cheng Li
  • Patent number: 11004270
    Abstract: A virtual model placement system can generate virtual floors and virtual walls to correspond to a real-world environment. Virtual items such as doors, windows, lamps, can be placed on the generated virtual walls and the system can generate dynamic updates of the placed items in response to movement by a user's device (e.g., a smartphone moving from right to left). The virtual items can be initially placed as primitives and then rendered to new positions upon the user selecting a render or lock instruction.
    Type: Grant
    Filed: September 11, 2019
    Date of Patent: May 11, 2021
    Assignee: Houzz, Inc.
    Inventors: Shay Rom, Eli Konky
  • Patent number: 11004243
    Abstract: Projection images of reduced resolution are generated by reducing resolution of filtered projection images and/or reducing the number of filtered projection images. Volume data of reduced resolution is generated by performing CT reconstruction using the projection images of reduced resolution. Each voxel of the volume data of reduced resolution is provisionally divided. The provisionally divided voxels are compared in voxel value before and after provisional division. If a difference in voxel value before and after the provisional division is greater than a threshold, the provisional division is determined to be valid, and division is further continued. If the difference in voxel value before and after the provisional division is less than or equal to the threshold, the provisional division is determined to be invalid and the voxel ends being divided.
    Type: Grant
    Filed: June 28, 2019
    Date of Patent: May 11, 2021
    Assignees: THE UNIVERSITY OF TOKYO, MITUTOYO CORPORATION
    Inventors: Yutaka Ohtake, Tomonori Goto, Masato Kon
  • Patent number: 11004261
    Abstract: A method of generating a three-dimensional point cloud includes obtaining a plurality of image data sources through a plurality of sensors, and performing fusion processing according to the plurality of image data sources to obtain the three-dimensional point cloud.
    Type: Grant
    Filed: May 15, 2019
    Date of Patent: May 11, 2021
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Yao Yao, Kaiyong Zhao, Shizhen Zheng, Cihui Pan
  • Patent number: 11006147
    Abstract: An apparatus for decoding 3D video data is provided, the 3D video data comprising a plurality of texture frames and a plurality of associated depth maps, the apparatus comprising: a first texture decoder configured to decode a video coding block of a first texture frame associated with a first view; a first depth map decoder configured to decode a video coding block of a first depth map associated with the first texture frame; a depth map filter configured to generate an auxiliary depth map on the basis of the first depth map; a first view synthesis prediction unit configured to generate a predicted video coding block of a view synthesis predicted second texture frame associated with a second view on the basis of the video coding block of the first texture frame and the auxiliary depth map.
    Type: Grant
    Filed: December 14, 2018
    Date of Patent: May 11, 2021
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Zhijie Zhao, Jens Schneider, Johannes Sauer, Mathias Wien
  • Patent number: 11003305
    Abstract: Systems and methods for displaying a three-dimensional (3D) workspace, including a 3D internet browser, in addition to a traditional two-dimensional (2D) workspace and for browsing the internet in a 3D/virtual reality workspace and transforming and/or upconverting objects and/or visual media from the 2D workspace and/or 2D webpages to the 3D workspace as 3D objects and/or stereoscopic output for display in the 3D workspace.
    Type: Grant
    Filed: November 18, 2016
    Date of Patent: May 11, 2021
    Assignee: ZSPACE, INC.
    Inventors: Clifford S. Champion, Eduardo Baraf, Alexandre R. Lelievre, Jonathan J. Hosenpud
  • Patent number: 11004233
    Abstract: An intelligent vision-based detection and ranging (iVidar) system consists of at least four cameras to form at least two stereo vision systems. The first pair of two cameras forms a first stereo vision system with a field of view A1 and has a baseline B1. The second pair of two cameras forms a second stereo vision system with a field of view A2 and has a baseline B2. Where B2 is greater than B1 and A2 is smaller than A1. One of the preferred configurations for the current invention is to mount the second stereo vision system field of view A2 to cover a perspective vanishing point in the along-track direction.
    Type: Grant
    Filed: May 1, 2020
    Date of Patent: May 11, 2021
    Inventor: Ynjiun Paul Wang
  • Patent number: 11004262
    Abstract: A method includes constructing a three-dimensional model of a front side of a row of trees based on a plurality of images of the front side of the row of trees and constructing a three-dimensional model of a back side of the row of trees based on a plurality of images of the back side of the row of trees. The three-dimensional model of the front side of the row of trees is merged with the three-dimensional model of the back side of the row of trees by linking a trunk in the three-dimensional model of the front side to a trunk in the three-dimensional model of the back side to form a merged three-dimensional model of the row of trees. The merged three-dimensional model of the row of trees is used to determine a physical attribute of the row of trees.
    Type: Grant
    Filed: August 14, 2019
    Date of Patent: May 11, 2021
    Assignee: Regents of the University of Minnesota
    Inventors: Ibrahim Volkan Isler, Wenbo Dong, Pravakar Roy
  • Patent number: 11003939
    Abstract: There is provided with an information processing apparatus. From an image capturing apparatus which can move, a captured image of an object is obtained. The position of the image capturing apparatus is derived using the captured image and a three-dimensional map. The three-dimensional map is corrected using information indicating a reliability of: information indicating the three-dimensional position of the feature included in a predefined area in the three-dimensional map held by the holding unit; and information indicating a three-dimensional position of another feature of the object, the information obtained based on the captured image from an expanded area of the predefined area in the three-dimensional map held by the holding unit.
    Type: Grant
    Filed: June 25, 2019
    Date of Patent: May 11, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Daisuke Kotake, Akihiro Katayama, Makoto Tomioka, Nozomu Kasuya, Takayuki Yamada, Masahiro Suzuki, Masakazu Fujiki
  • Patent number: 11004240
    Abstract: Disclosed is a hierarchical division-based point cloud attribute compression method. For point cloud attribute information, a new hierarchical division based coding scheme is proposed, wherein a frame of point cloud is adaptively divided into a “stripe-macroblock-block” hierarchical structure according to the spatial position and color distribution of the point cloud, and stripes are coded independently from one another, increasing the coding efficiency, enhancing the fault tolerance of a system and improving the performance of point cloud attribute compression. The method comprises: (1) inputting a point cloud; (2) division of a k-dimension (KD) tree structure of the point cloud; (3) continuity analysis of point cloud attribute information; (4) stripe division of the point cloud; (5) division of macroblocks and coding blocks of the point cloud; and (6) intra-frame prediction, transformation, quantification and entropy coding based on a block structure.
    Type: Grant
    Filed: May 15, 2018
    Date of Patent: May 11, 2021
    Inventors: Ge Li, Yi Ting Shao, Qi Zhang, Rong Gang Wang, Tie Jun Huang, Wen Gao
  • Patent number: 10996746
    Abstract: Techniques for implementing eye tracking using various real-time computational solutions to a three-dimensional eye tracking framework. An exemplary eye tracking system for a NED device includes sensors that are directed toward and angularly offset from a user's eyes in a manner that causes circular features (e.g., irises and/or pupils) of the user's eyes to appear elliptical within sensor planes of the individual sensors. An iris and/or pupil of an eye will appear circular when the eye is looked at straight on (i.e., perpendicular to an optical axis of the eye's lens) but elliptical when observed from an angular offset. The eye tracking systems and methods disclosed herein exploit these principles to track movements of the user's eyes with a higher degree of accuracy than conventional eye tracking systems.
    Type: Grant
    Filed: May 16, 2019
    Date of Patent: May 4, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Sergio Ortiz Egea, Jian Feng Gao, Alfonsus D. Lunardhi, Venkata Satya Raghavendra Bulusu
  • Patent number: 10997239
    Abstract: The image search system according to the present invention accumulates virtual viewpoint video image data generated based on image data obtained by capturing an object from a plurality of directions by a plurality of cameras and a virtual viewpoint parameter used for generation of the virtual viewpoint video image data in association with each other. Then, the image search system extracts, in a case where a search condition is input via an input unit, virtual viewpoint video image data associated with a virtual viewpoint parameter corresponding to the search condition from the accumulated virtual viewpoint video image data. Further, the image search system presents information of the extracted virtual viewpoint video image data as results of the search. Due to this, convenience relating to a search for a virtual viewpoint video image improves.
    Type: Grant
    Filed: March 6, 2019
    Date of Patent: May 4, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Yuya Ota
  • Patent number: 10997433
    Abstract: In various examples, sensor data representative of an image of a field of view of a vehicle sensor may be received and the sensor data may be applied to a machine learning model. The machine learning model may compute a segmentation mask representative of portions of the image corresponding to lane markings of the driving surface of the vehicle. Analysis of the segmentation mask may be performed to determine lane marking types, and lane boundaries may be generated by performing curve fitting on the lane markings corresponding to each of the lane marking types. The data representative of the lane boundaries may then be sent to a component of the vehicle for use in navigating the vehicle through the driving surface.
    Type: Grant
    Filed: February 26, 2019
    Date of Patent: May 4, 2021
    Assignee: NVIDIA Corporation
    Inventors: Yifang Xu, Xin Liu, Chia-Chih Chen, Carolina Parada, Davide Onofrio, Minwoo Park, Mehdi Sajjadi Mohammadabadi, Vijay Chintalapudi, Ozan Tonkal, John Zedlewski, Pekka Janis, Jan Nikolaus Fritsch, Gordon Grigor, Zuoguan Wang, I-Kuei Chen, Miguel Sainz
  • Patent number: 10997910
    Abstract: A display device includes: a display panel including a first pixel, a second pixel adjacent to one side of the first pixel, and a third pixel adjacent to the other side of the first pixel; a first scan driver supplying a first signal to the first to third pixels through a first scan line; a second scan driver supplying a second scan signal to the second and third pixels through a second scan line when a first time elapses after the supply of the first scan signal is started; a data driver supplying a data voltage to a plurality of output lines; and a data divider selectively supplying the data voltage to data lines respectively coupled to the first to third pixels. Each of the second and third pixels includes a switching transistor controlled by the second scan signal.
    Type: Grant
    Filed: August 2, 2018
    Date of Patent: May 4, 2021
    Inventors: Young In Hwang, Elly Gil, Jin A Lee, Joo Hyeon Jo, Seong Baik Chu
  • Patent number: 10993603
    Abstract: Provided are an image processing device, an image processing method, and an endoscope system that can reduce a burden on a user. A parallax amount adjustment unit adjusts the parallax amount of a three-dimensional (3D) biological image of an imaged living organism, depending on whether the parallax of the 3D biological image puts a burden on a user.
    Type: Grant
    Filed: November 27, 2019
    Date of Patent: May 4, 2021
    Assignee: SONY CORPORATION
    Inventors: Hisakazu Shiraki, Koji Kashima, Toru Mitome
  • Patent number: 10999570
    Abstract: A lightweight, portable and configurable system for image acquisition for photogrammetry purposes includes a portable rig having at least two cameras supported thereon in spaced relation to one another. The cameras are angled towards one another and actuated in an automated fashion so as to capture images of an object at a minimum rate over time. At least a plurality of the captured images are used to digitally reconstruct three-dimensional geometry of the object.
    Type: Grant
    Filed: September 3, 2019
    Date of Patent: May 4, 2021
    Inventor: Johnathan R. Banta
  • Patent number: 10997473
    Abstract: Object localization based on spatial relationships can be performed by obtaining a plurality of 3D coordinates within a 3D space, generating a feature vector for each coordinate based on quantified spatial relationships between the corresponding coordinate and one or more other coordinates among the plurality of coordinates, and applying a regression process to the feature vectors to produce a locating function for relating quantified spatial relationships among the plurality of coordinates and a location within the 3D space.
    Type: Grant
    Filed: November 27, 2018
    Date of Patent: May 4, 2021
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventor: Marco Visentini Scarzanella
  • Patent number: 10997771
    Abstract: Position-based rendering apparatus and method for multi-die/GPU graphics processing. For example, one embodiment of a method comprises: distributing a plurality of graphics draws to a plurality of graphics processors; performing position-only shading using vertex data associated with tiles of a first draw on a first graphics processor, the first graphics processor responsively generating visibility data for each of the tiles; distributing subsets of the visibility data associated with different subsets of the tiles to different graphics processors; limiting geometry work to be performed on each tile by each graphics processor using the visibility data, each graphics processor to responsively generate rendered tiles; and wherein the rendered tiles are combined to generate a complete image frame.
    Type: Grant
    Filed: August 29, 2018
    Date of Patent: May 4, 2021
    Assignee: Intel Corporation
    Inventors: Travis Schluessler, Zack Waters, Michael Apodaca, Daniel Johnston, Jason Surprise, Prasoonkumar Surti, Subramaniam Maiyuran, Peter Doyle, Saurabh Sharma, Ankur Shah, Murali Ramadoss
  • Patent number: 10991160
    Abstract: Approaches described and suggested herein relate to generating three-dimensional representations of objects to be used to render virtual reality and augmented reality effects on personal devices such as smartphones and personal computers, for example. An initial surface mesh of an object is obtained. A plurality of silhouette masks of the object taken from a plurality of viewpoints is also obtained. A plurality of depth maps are generated from the initial surface mesh. Specifically, the plurality of depth maps are taken from the same plurality of viewpoints from which the silhouette images are taken. A volume including the object is discretized into a plurality of voxels. Each voxel is then determined to be either inside the object or outside of the object based on the silhouette masks and the depth data. A final mesh is then generated from the voxels that are determined to be inside the object.
    Type: Grant
    Filed: June 25, 2019
    Date of Patent: April 27, 2021
    Assignee: A9.com, Inc.
    Inventors: Himanshu Arora, Divyansh Agarwal, Arnab Dhua, Chun Kai Wang
  • Patent number: 10990851
    Abstract: A method and device for performing based learning on a medical image includes reading raw data of a medical image, performing transformation processing on the data by analyzing a data attribute, and integrating the same into a data format capable of being received by a model to be trained; selecting a transformation method by comparing parameters of the model to be trained and a trained model, so as to perform parameter transformation and apply transformation-based learning to training of the model to be trained for the medical image; and upon finishing model training, applying a parameter of a trained model to image category analysis. The invention further includes a device for performing transformation-based learning on a medical image, including: a data processing module; a transformation-based learning module; and an application module.
    Type: Grant
    Filed: February 1, 2019
    Date of Patent: April 27, 2021
    Assignee: Intervision Medical Technology Co., Ltd.
    Inventors: Kuan Chen, Rongguo Zhang
  • Patent number: 10991149
    Abstract: An ultrasonic diagnostic imaging system has an array probe for acquiring a 3D image dataset of a subject. Volume rendering is performed to produce a volume image of the subject, and MPR reconstruction is performed to produce three orthogonal 2D images of the subject. The point of intersection of the three 2D image planes is locationally marked by a crosshair or other graphic in each 2D image. The corresponding location in the volume image is marked with a virtual light source which illuminates the interior of the 3D volume and is positionally linked to the location markers in the MPR images.
    Type: Grant
    Filed: March 29, 2018
    Date of Patent: April 27, 2021
    Assignee: KONINKLIJKE PHILIPS N.V.
    Inventors: David Rust, Dorothy Anita Strassner
  • Patent number: 10990257
    Abstract: An object displaying method and a terminal device are disclosed. The method includes displaying at least a first portion and second portion of a graphic map layer in the first display region and second display region of a display screen of the terminal device, respectively; identifying a target object in the graphic map layer; determining a target display mode according to a current state of the target object among a plurality of states for the target object; and displaying the target object in the second display region according to the target display mode.
    Type: Grant
    Filed: March 12, 2019
    Date of Patent: April 27, 2021
    Assignee: Tencent Technology (Shenzhen) Company Limited
    Inventor: Yiran Wang
  • Patent number: 10990258
    Abstract: Systems and methods disclosed herein provide a method that includes obtaining, at a user device from a remote storage server, content relating to an electronic document, and rendering the content of the electronic document onto a first virtual rendering surface. The method further includes maintaining a second virtual rendering surface that stores a current state of the first virtual rendering surface. The method further includes obtaining an operation command relating to the electronic document, and retrieving first state information of the first virtual rendering surface and second state information of the second virtual rendering surface. The method further includes applying the operation command to the rendered content of the electronic document on the first virtual rendering surface, and updating at least one of the first state information or the second state information based on a type of the operation command.
    Type: Grant
    Filed: August 4, 2016
    Date of Patent: April 27, 2021
    Assignee: GOOGLE LLC
    Inventors: Haluk Burcin Tunali, Luiz do Amaral de Franca Pereira Filho, Etan Bukiet, Behnoosh Hariri, Norbert Zsolt Kenderesi, Igor Kopylov, Matthew Jay Isison, Kevin Winter, Olga Sergeyevna Saviano, Gregory George Galante, Mathieu Turcotte, Jacob Robert Voytko, Leeran Raphaely
  • Patent number: 10990421
    Abstract: An artificial intelligence (“AI”) based system is disclosed for associating low-level user content, such as documents, email messages, and calendar invites, with high-level user activities using topics as an abstraction. The associations can enable a computing system to provide, among other things, activity-specific views that present a specific selection of low-level user content that is most relevant to a user at a particular point in time. The activity-specific views present the right information to users at the right time based on a context of a user and a user's past activities.
    Type: Grant
    Filed: June 27, 2018
    Date of Patent: April 27, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Aniruddha Prabhakar Kulkarni, Nathaniel M. Myhre, Yogesh Madhukarrao Joshi, William Henry Gates, III, Vignesh Sachidanandam, Peter Loren Engrav
  • Patent number: 10991112
    Abstract: Aspects relate to processing captured images from structured light systems. An example device may include one or more processors and a memory. The memory may include instructions that, when executed by the one or more processors, cause the device to receive a captured image of a scene from a structured light receiver, analyze one or more first portions of the captured image at a first scale, and analyze one or more second portions of the captured image at a second scale finer than the first scale. The analysis of the one or more second portions may be based on the analysis of the one or more first portions. The instructions further may cause the device to determine for each of the one or more second portions a codeword from a codeword distribution and determine one or more depths in the scene based on the one or more determined codewords.
    Type: Grant
    Filed: July 19, 2018
    Date of Patent: April 27, 2021
    Assignee: QUALCOMM Incorporated
    Inventors: Hasib Siddiqui, James Nash, Kalin Atanassov
  • Patent number: 10991152
    Abstract: One embodiment of the present invention includes a parallel processing unit (PPU) that performs pixel shading at variable granularities. For effects that vary at a low frequency across a pixel block, a coarse shading unit performs the associated shading operations on a subset of the pixels in the pixel block. By contrast, for effects that vary at a high frequency across the pixel block, fine shading units perform the associated shading operations on each pixel in the pixel block. Because the PPU implements coarse shading units and fine shading units, the PPU may tune the shading rate per-effect based on the frequency of variation across each pixel group. By contrast, conventional PPUs typically compute all effects per-pixel, performing redundant shading operations for low frequency effects. Consequently, to produce similar image quality, the PPU consumes less power and increases the rendering frame rate compared to a conventional PPU.
    Type: Grant
    Filed: January 20, 2017
    Date of Patent: April 27, 2021
    Assignee: NVIDIA Corporation
    Inventors: Yong He, Eric B. Lum, Eric Enderton, Henry Packard Moreton, Kayvon Fatahalian
  • Patent number: 10991147
    Abstract: Hybrid ray tracing method for generating photorealistic reflections while keeping coherence of secondary rays. The coherence is achieved by handling secondary rays with collective origin and collective destination, attaining high parallelism and high utilization of GPU.
    Type: Grant
    Filed: May 15, 2020
    Date of Patent: April 27, 2021
    Assignee: ADSHIR LTD.
    Inventors: Reuven Bakalash, Ron Weitzman
  • Patent number: 10989540
    Abstract: A binocular vision localization method, device and system are provided. The method includes calculating first pose change information according to two frames of images collected by a binocular camera unit at two consecutive moments and calculating second pose change information according to inertia parameters collected by an inertial measurement unit between the two consecutive moments. Matched feature points in the two frames are extracted from the two frames respectively. A reprojection error of each feature point is calculated. The calculations are taken as nodes or edges of a general graph optimization algorithm to acquire optimized third pose change information for localization. The system includes a binocular vision localization device, and a binocular camera unit and an inertial measurement unit respectively connected thereto, a left-eye camera and a right-eye camera are symmetrically located on two sides of the inertial measurement unit.
    Type: Grant
    Filed: July 18, 2018
    Date of Patent: April 27, 2021
    Assignee: GOERTEK INC.
    Inventors: Haoran Song, Tianrong Dai, Yuchuan Ren, Shunming Li, Jinxi Cao
  • Patent number: 10989561
    Abstract: A method for mapping data relating to the conditions on a road, the method including the following steps: (a) a step for recording, in a database, information relating to the weather conditions on a road, determined by a vehicle travelling on the road, (b) a step for recording the GPS position of the vehicle corresponding to the recordings made, and (c) a step for displaying, on a map showing the route followed by the vehicle, the weather conditions as a function of the GPS position.
    Type: Grant
    Filed: December 14, 2016
    Date of Patent: April 27, 2021
    Assignee: COMPAGNIE GENERALE DES ETABLISSEMENTS MICHELIN
    Inventors: Antoine Paturle, Clément Petit, Frédéric Terrettaz
  • Patent number: 10980418
    Abstract: Disclosed are various examples of embodiments of systems, devices, components and methods configured to detect a location of a source of at least one cardiac rhythm disorder in a patient's heart. In some embodiments, electrogram signals are acquired from inside a patient's heart, and subsequently normalized, adjusted and/or filtered, followed by generating a two-dimensional (2D) spatial map, grid or representation of the electrode positions, processing the amplitude-adjusted and filtered electrogram signals to generate a plurality of three-dimensional electrogram surfaces corresponding at least partially to the 2 D grid, one surface being generated for each or selected discrete times, and processing the plurality of three-dimensional electrogram surfaces through time to generate a velocity vector map corresponding at least partially to the 2 D grid.
    Type: Grant
    Filed: December 24, 2018
    Date of Patent: April 20, 2021
    Assignee: Ablacon Inc.
    Inventor: Peter Ruppersberg
  • Patent number: 10983597
    Abstract: The technology disclosed relates to automatically (e.g., programmatically) initializing predictive information for tracking a complex control object (e.g., hand, hand and tool combination, robot end effector) based upon information about characteristics of the object determined from sets of collected observed information. Automated initialization techniques obviate the need for special and often bizarre start-up rituals (place your hands on the screen at the places indicated during a full moon, and so forth) required by conventional techniques. In implementations, systems can refine initial predictive information to reflect an observed condition based on comparison of the observed with an analysis of sets of collected observed information.
    Type: Grant
    Filed: February 28, 2020
    Date of Patent: April 20, 2021
    Assignee: Ultrahaptics IP Two Limited
    Inventor: Kevin A. Horowitz
  • Patent number: 10981065
    Abstract: An example of an information processing apparatus places an object in a virtual space. The information processing apparatus counts, for at least one type of the object, a placement number of the objects placed in the virtual space. The information processing apparatus presents candidates of a clear condition including a condition relating to the object, on the basis of the counted placement number, in a selectable manner for a user. The clear condition is used for determining that a game using the virtual space has been cleared. The information processing apparatus sets a candidate selected by the user, as the clear condition.
    Type: Grant
    Filed: March 27, 2019
    Date of Patent: April 20, 2021
    Assignee: Nintendo Co., Ltd.
    Inventors: Yosuke Oshino, Fumiya Nakano
  • Patent number: 10984586
    Abstract: In some instances, spatial mapping data from one spatial mapping is used to augment the spatial mapping data in another spatial mapping. First and second spatial mapping data is accessed, where both the first and second spatial mapping data overlap in that they both, at least partially, describe the same portion of an environment three-dimensionally. A determination is made as to whether the second spatial mapping data is to augment the first spatial mapping data. If so, then the second spatial mapping data is used to augment the first spatial mapping data. Otherwise, the second spatial mapping data is not used to augment the first spatial mapping data. These determinations may be based, at least in part, on determined quality levels of the first and second spatial mapping data.
    Type: Grant
    Filed: July 27, 2018
    Date of Patent: April 20, 2021
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Raymond Kirk Price, Yuri Pekelny, Michael Bleyer
  • Patent number: 10984582
    Abstract: Systems and methods for rendering vector data in conjunction with a three-dimensional model are provided. In particular, a smooth transparent draping layer can be generated and rendered overlaying the three-dimensional model. The vector data can be texture mapped to the smooth transparent draping layer such that the vector data appears to be located along a surface in the three-dimensional model. The three-dimensional model can be a model of a geographic area and can include terrain geometry that models the terrain of the geographic area and building geometry that models buildings, bridges, and other objects in the geographic area. The smooth transparent draping layer can conform to the surfaces defined by the terrain geometry. The vector data can be texture mapped to the smooth transparent draping layer such that the vector data appears to be located along the surface of the terrain geometry but can be occluded by the building geometry.
    Type: Grant
    Filed: December 20, 2019
    Date of Patent: April 20, 2021
    Assignee: Google LLC
    Inventors: Ryan Styles Overbeck, Janne Kontkanen
  • Patent number: 10983201
    Abstract: Techniques are disclosed for real-time mapping in a movable object environment. A system for real-time mapping in a movable object environment, may include at least one movable object including a computing device, a scanning sensor electronically coupled to the computing device, and a positioning sensor electronically coupled to the computing device. The system may further include a client device in communication with the at least one movable object, the client device including a visualization application which is configured to receive point cloud data from the scanning sensor and position data from the positioning sensor, record the point cloud data and the position data to a storage location, generate a real-time visualization of the point cloud data and the position data as it is received, and display the real-time visualization using a user interface provided by the visualization application.
    Type: Grant
    Filed: October 25, 2019
    Date of Patent: April 20, 2021
    Assignee: DJI Technology, Inc.
    Inventors: Alain Pimentel, Kalyani Premji Nirmal, Comran Morshed, Arjun Sukumar Menon, Weifeng Liu
  • Patent number: 10984587
    Abstract: Multiple snapshots of a scene are captured within an executing application (e.g., a video game). When each snapshot is captured, associated color values per pixel and a distance or depth value z per pixel are stored. The depth information from the snapshots is accessed, and a point cloud representing the depth information is constructed. A mesh structure is constructed from the point cloud. The light field(s) on the surface(s) of the mesh structure are calculated. A surface light field is represented as a texture. A renderer uses the surface light field with geometry information to reproduce the scene captured in the snapshots. The reproduced scene can be manipulated and viewed from different perspectives.
    Type: Grant
    Filed: June 7, 2019
    Date of Patent: April 20, 2021
    Assignee: NVIDIA Corporation
    Inventors: Dmitry Duka, Rev Lebaredian, Jonathan Small, Ivan Shutov
  • Patent number: 10984583
    Abstract: Various implementations are disclosed of producing a 3-dimensional model of a scene. Various method, electronic device, or system implementations use RGB-D camera to provide RGB-D video content or periodic aligned RGB images and depth images to localize camera spatial position(s) defined in a three dimensional (3D) coordinate system or reconstruct a 3D virtual representation of a current camera frame in the 3D coordinate system, each in real time.
    Type: Grant
    Filed: February 28, 2019
    Date of Patent: April 20, 2021
    Assignee: Apple Inc.
    Inventor: Maxime Meilland
  • Patent number: 10984579
    Abstract: A system and method of playing back 3D animations includes receiving user selection of a 3D file that contains animation parameters of an animated 3D model such as a preset animation or an embedded customized animation and inserting the animated 3D model into a 2D display canvas while preserving the animation parameters of the animated 3D model described in the 3D file. The animated 3D model is played and paused on the 2D display canvas under user control independent of a main thread that enables interaction with and editing of other content besides the animated 3D model in the 2D display. User adjustment of animation parameters of the animated 3D model during playback are received and the animated 3D model with the received user adjusted animation parameters are presented to the 2D display canvas on a display device.
    Type: Grant
    Filed: May 31, 2019
    Date of Patent: April 20, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Aimee Leong, Matt Kernek, Stephanie Horn, Jie Li, Varun Pandey, Mikko Mannisto, Eduardo Lemus Velazquez
  • Patent number: 10983770
    Abstract: A computing system may include a computing device configured to build modules of script code into bundles, and a bundler application executable to perform operations comprising: obtaining one or more of the modules of script code that are designated for bundling with one another; organizing the modules of script code into one or more chunks; for each respective chunk of the one or more chunks: (i) determining whether the respective chunk is to be assigned a deterministic chunk identifier or a non-deterministic chunk identifier, and (ii) assigning the respective chunk a chunk identifier as determined, where deterministic chunk identifiers are usable for referencing by additional modules of script code both within and not within in the respective chunk, and where the deterministic chunk identifiers are independent of characteristics of the computing device; and writing the one or more chunks to a bundle.
    Type: Grant
    Filed: June 9, 2020
    Date of Patent: April 20, 2021
    Assignee: ServiceNow, Inc.
    Inventor: Jason Strimpel