Three-dimension Patents (Class 345/419)
  • Patent number: 10997771
    Abstract: Position-based rendering apparatus and method for multi-die/GPU graphics processing. For example, one embodiment of a method comprises: distributing a plurality of graphics draws to a plurality of graphics processors; performing position-only shading using vertex data associated with tiles of a first draw on a first graphics processor, the first graphics processor responsively generating visibility data for each of the tiles; distributing subsets of the visibility data associated with different subsets of the tiles to different graphics processors; limiting geometry work to be performed on each tile by each graphics processor using the visibility data, each graphics processor to responsively generate rendered tiles; and wherein the rendered tiles are combined to generate a complete image frame.
    Type: Grant
    Filed: August 29, 2018
    Date of Patent: May 4, 2021
    Assignee: Intel Corporation
    Inventors: Travis Schluessler, Zack Waters, Michael Apodaca, Daniel Johnston, Jason Surprise, Prasoonkumar Surti, Subramaniam Maiyuran, Peter Doyle, Saurabh Sharma, Ankur Shah, Murali Ramadoss
  • Patent number: 10997433
    Abstract: In various examples, sensor data representative of an image of a field of view of a vehicle sensor may be received and the sensor data may be applied to a machine learning model. The machine learning model may compute a segmentation mask representative of portions of the image corresponding to lane markings of the driving surface of the vehicle. Analysis of the segmentation mask may be performed to determine lane marking types, and lane boundaries may be generated by performing curve fitting on the lane markings corresponding to each of the lane marking types. The data representative of the lane boundaries may then be sent to a component of the vehicle for use in navigating the vehicle through the driving surface.
    Type: Grant
    Filed: February 26, 2019
    Date of Patent: May 4, 2021
    Assignee: NVIDIA Corporation
    Inventors: Yifang Xu, Xin Liu, Chia-Chih Chen, Carolina Parada, Davide Onofrio, Minwoo Park, Mehdi Sajjadi Mohammadabadi, Vijay Chintalapudi, Ozan Tonkal, John Zedlewski, Pekka Janis, Jan Nikolaus Fritsch, Gordon Grigor, Zuoguan Wang, I-Kuei Chen, Miguel Sainz
  • Patent number: 10999570
    Abstract: A lightweight, portable and configurable system for image acquisition for photogrammetry purposes includes a portable rig having at least two cameras supported thereon in spaced relation to one another. The cameras are angled towards one another and actuated in an automated fashion so as to capture images of an object at a minimum rate over time. At least a plurality of the captured images are used to digitally reconstruct three-dimensional geometry of the object.
    Type: Grant
    Filed: September 3, 2019
    Date of Patent: May 4, 2021
    Inventor: Johnathan R. Banta
  • Patent number: 10996746
    Abstract: Techniques for implementing eye tracking using various real-time computational solutions to a three-dimensional eye tracking framework. An exemplary eye tracking system for a NED device includes sensors that are directed toward and angularly offset from a user's eyes in a manner that causes circular features (e.g., irises and/or pupils) of the user's eyes to appear elliptical within sensor planes of the individual sensors. An iris and/or pupil of an eye will appear circular when the eye is looked at straight on (i.e., perpendicular to an optical axis of the eye's lens) but elliptical when observed from an angular offset. The eye tracking systems and methods disclosed herein exploit these principles to track movements of the user's eyes with a higher degree of accuracy than conventional eye tracking systems.
    Type: Grant
    Filed: May 16, 2019
    Date of Patent: May 4, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Sergio Ortiz Egea, Jian Feng Gao, Alfonsus D. Lunardhi, Venkata Satya Raghavendra Bulusu
  • Patent number: 10993603
    Abstract: Provided are an image processing device, an image processing method, and an endoscope system that can reduce a burden on a user. A parallax amount adjustment unit adjusts the parallax amount of a three-dimensional (3D) biological image of an imaged living organism, depending on whether the parallax of the 3D biological image puts a burden on a user.
    Type: Grant
    Filed: November 27, 2019
    Date of Patent: May 4, 2021
    Assignee: SONY CORPORATION
    Inventors: Hisakazu Shiraki, Koji Kashima, Toru Mitome
  • Patent number: 10997239
    Abstract: The image search system according to the present invention accumulates virtual viewpoint video image data generated based on image data obtained by capturing an object from a plurality of directions by a plurality of cameras and a virtual viewpoint parameter used for generation of the virtual viewpoint video image data in association with each other. Then, the image search system extracts, in a case where a search condition is input via an input unit, virtual viewpoint video image data associated with a virtual viewpoint parameter corresponding to the search condition from the accumulated virtual viewpoint video image data. Further, the image search system presents information of the extracted virtual viewpoint video image data as results of the search. Due to this, convenience relating to a search for a virtual viewpoint video image improves.
    Type: Grant
    Filed: March 6, 2019
    Date of Patent: May 4, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Yuya Ota
  • Patent number: 10997473
    Abstract: Object localization based on spatial relationships can be performed by obtaining a plurality of 3D coordinates within a 3D space, generating a feature vector for each coordinate based on quantified spatial relationships between the corresponding coordinate and one or more other coordinates among the plurality of coordinates, and applying a regression process to the feature vectors to produce a locating function for relating quantified spatial relationships among the plurality of coordinates and a location within the 3D space.
    Type: Grant
    Filed: November 27, 2018
    Date of Patent: May 4, 2021
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventor: Marco Visentini Scarzanella
  • Patent number: 10997910
    Abstract: A display device includes: a display panel including a first pixel, a second pixel adjacent to one side of the first pixel, and a third pixel adjacent to the other side of the first pixel; a first scan driver supplying a first signal to the first to third pixels through a first scan line; a second scan driver supplying a second scan signal to the second and third pixels through a second scan line when a first time elapses after the supply of the first scan signal is started; a data driver supplying a data voltage to a plurality of output lines; and a data divider selectively supplying the data voltage to data lines respectively coupled to the first to third pixels. Each of the second and third pixels includes a switching transistor controlled by the second scan signal.
    Type: Grant
    Filed: August 2, 2018
    Date of Patent: May 4, 2021
    Inventors: Young In Hwang, Elly Gil, Jin A Lee, Joo Hyeon Jo, Seong Baik Chu
  • Patent number: 10989561
    Abstract: A method for mapping data relating to the conditions on a road, the method including the following steps: (a) a step for recording, in a database, information relating to the weather conditions on a road, determined by a vehicle travelling on the road, (b) a step for recording the GPS position of the vehicle corresponding to the recordings made, and (c) a step for displaying, on a map showing the route followed by the vehicle, the weather conditions as a function of the GPS position.
    Type: Grant
    Filed: December 14, 2016
    Date of Patent: April 27, 2021
    Assignee: COMPAGNIE GENERALE DES ETABLISSEMENTS MICHELIN
    Inventors: Antoine Paturle, Clément Petit, Frédéric Terrettaz
  • Patent number: 10990851
    Abstract: A method and device for performing based learning on a medical image includes reading raw data of a medical image, performing transformation processing on the data by analyzing a data attribute, and integrating the same into a data format capable of being received by a model to be trained; selecting a transformation method by comparing parameters of the model to be trained and a trained model, so as to perform parameter transformation and apply transformation-based learning to training of the model to be trained for the medical image; and upon finishing model training, applying a parameter of a trained model to image category analysis. The invention further includes a device for performing transformation-based learning on a medical image, including: a data processing module; a transformation-based learning module; and an application module.
    Type: Grant
    Filed: February 1, 2019
    Date of Patent: April 27, 2021
    Assignee: Intervision Medical Technology Co., Ltd.
    Inventors: Kuan Chen, Rongguo Zhang
  • Patent number: 10990421
    Abstract: An artificial intelligence (“AI”) based system is disclosed for associating low-level user content, such as documents, email messages, and calendar invites, with high-level user activities using topics as an abstraction. The associations can enable a computing system to provide, among other things, activity-specific views that present a specific selection of low-level user content that is most relevant to a user at a particular point in time. The activity-specific views present the right information to users at the right time based on a context of a user and a user's past activities.
    Type: Grant
    Filed: June 27, 2018
    Date of Patent: April 27, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Aniruddha Prabhakar Kulkarni, Nathaniel M. Myhre, Yogesh Madhukarrao Joshi, William Henry Gates, III, Vignesh Sachidanandam, Peter Loren Engrav
  • Patent number: 10991149
    Abstract: An ultrasonic diagnostic imaging system has an array probe for acquiring a 3D image dataset of a subject. Volume rendering is performed to produce a volume image of the subject, and MPR reconstruction is performed to produce three orthogonal 2D images of the subject. The point of intersection of the three 2D image planes is locationally marked by a crosshair or other graphic in each 2D image. The corresponding location in the volume image is marked with a virtual light source which illuminates the interior of the 3D volume and is positionally linked to the location markers in the MPR images.
    Type: Grant
    Filed: March 29, 2018
    Date of Patent: April 27, 2021
    Assignee: KONINKLIJKE PHILIPS N.V.
    Inventors: David Rust, Dorothy Anita Strassner
  • Patent number: 10991112
    Abstract: Aspects relate to processing captured images from structured light systems. An example device may include one or more processors and a memory. The memory may include instructions that, when executed by the one or more processors, cause the device to receive a captured image of a scene from a structured light receiver, analyze one or more first portions of the captured image at a first scale, and analyze one or more second portions of the captured image at a second scale finer than the first scale. The analysis of the one or more second portions may be based on the analysis of the one or more first portions. The instructions further may cause the device to determine for each of the one or more second portions a codeword from a codeword distribution and determine one or more depths in the scene based on the one or more determined codewords.
    Type: Grant
    Filed: July 19, 2018
    Date of Patent: April 27, 2021
    Assignee: QUALCOMM Incorporated
    Inventors: Hasib Siddiqui, James Nash, Kalin Atanassov
  • Patent number: 10991160
    Abstract: Approaches described and suggested herein relate to generating three-dimensional representations of objects to be used to render virtual reality and augmented reality effects on personal devices such as smartphones and personal computers, for example. An initial surface mesh of an object is obtained. A plurality of silhouette masks of the object taken from a plurality of viewpoints is also obtained. A plurality of depth maps are generated from the initial surface mesh. Specifically, the plurality of depth maps are taken from the same plurality of viewpoints from which the silhouette images are taken. A volume including the object is discretized into a plurality of voxels. Each voxel is then determined to be either inside the object or outside of the object based on the silhouette masks and the depth data. A final mesh is then generated from the voxels that are determined to be inside the object.
    Type: Grant
    Filed: June 25, 2019
    Date of Patent: April 27, 2021
    Assignee: A9.com, Inc.
    Inventors: Himanshu Arora, Divyansh Agarwal, Arnab Dhua, Chun Kai Wang
  • Patent number: 10990257
    Abstract: An object displaying method and a terminal device are disclosed. The method includes displaying at least a first portion and second portion of a graphic map layer in the first display region and second display region of a display screen of the terminal device, respectively; identifying a target object in the graphic map layer; determining a target display mode according to a current state of the target object among a plurality of states for the target object; and displaying the target object in the second display region according to the target display mode.
    Type: Grant
    Filed: March 12, 2019
    Date of Patent: April 27, 2021
    Assignee: Tencent Technology (Shenzhen) Company Limited
    Inventor: Yiran Wang
  • Patent number: 10990258
    Abstract: Systems and methods disclosed herein provide a method that includes obtaining, at a user device from a remote storage server, content relating to an electronic document, and rendering the content of the electronic document onto a first virtual rendering surface. The method further includes maintaining a second virtual rendering surface that stores a current state of the first virtual rendering surface. The method further includes obtaining an operation command relating to the electronic document, and retrieving first state information of the first virtual rendering surface and second state information of the second virtual rendering surface. The method further includes applying the operation command to the rendered content of the electronic document on the first virtual rendering surface, and updating at least one of the first state information or the second state information based on a type of the operation command.
    Type: Grant
    Filed: August 4, 2016
    Date of Patent: April 27, 2021
    Assignee: GOOGLE LLC
    Inventors: Haluk Burcin Tunali, Luiz do Amaral de Franca Pereira Filho, Etan Bukiet, Behnoosh Hariri, Norbert Zsolt Kenderesi, Igor Kopylov, Matthew Jay Isison, Kevin Winter, Olga Sergeyevna Saviano, Gregory George Galante, Mathieu Turcotte, Jacob Robert Voytko, Leeran Raphaely
  • Patent number: 10991152
    Abstract: One embodiment of the present invention includes a parallel processing unit (PPU) that performs pixel shading at variable granularities. For effects that vary at a low frequency across a pixel block, a coarse shading unit performs the associated shading operations on a subset of the pixels in the pixel block. By contrast, for effects that vary at a high frequency across the pixel block, fine shading units perform the associated shading operations on each pixel in the pixel block. Because the PPU implements coarse shading units and fine shading units, the PPU may tune the shading rate per-effect based on the frequency of variation across each pixel group. By contrast, conventional PPUs typically compute all effects per-pixel, performing redundant shading operations for low frequency effects. Consequently, to produce similar image quality, the PPU consumes less power and increases the rendering frame rate compared to a conventional PPU.
    Type: Grant
    Filed: January 20, 2017
    Date of Patent: April 27, 2021
    Assignee: NVIDIA Corporation
    Inventors: Yong He, Eric B. Lum, Eric Enderton, Henry Packard Moreton, Kayvon Fatahalian
  • Patent number: 10989540
    Abstract: A binocular vision localization method, device and system are provided. The method includes calculating first pose change information according to two frames of images collected by a binocular camera unit at two consecutive moments and calculating second pose change information according to inertia parameters collected by an inertial measurement unit between the two consecutive moments. Matched feature points in the two frames are extracted from the two frames respectively. A reprojection error of each feature point is calculated. The calculations are taken as nodes or edges of a general graph optimization algorithm to acquire optimized third pose change information for localization. The system includes a binocular vision localization device, and a binocular camera unit and an inertial measurement unit respectively connected thereto, a left-eye camera and a right-eye camera are symmetrically located on two sides of the inertial measurement unit.
    Type: Grant
    Filed: July 18, 2018
    Date of Patent: April 27, 2021
    Assignee: GOERTEK INC.
    Inventors: Haoran Song, Tianrong Dai, Yuchuan Ren, Shunming Li, Jinxi Cao
  • Patent number: 10991147
    Abstract: Hybrid ray tracing method for generating photorealistic reflections while keeping coherence of secondary rays. The coherence is achieved by handling secondary rays with collective origin and collective destination, attaining high parallelism and high utilization of GPU.
    Type: Grant
    Filed: May 15, 2020
    Date of Patent: April 27, 2021
    Assignee: ADSHIR LTD.
    Inventors: Reuven Bakalash, Ron Weitzman
  • Patent number: 10980418
    Abstract: Disclosed are various examples of embodiments of systems, devices, components and methods configured to detect a location of a source of at least one cardiac rhythm disorder in a patient's heart. In some embodiments, electrogram signals are acquired from inside a patient's heart, and subsequently normalized, adjusted and/or filtered, followed by generating a two-dimensional (2D) spatial map, grid or representation of the electrode positions, processing the amplitude-adjusted and filtered electrogram signals to generate a plurality of three-dimensional electrogram surfaces corresponding at least partially to the 2 D grid, one surface being generated for each or selected discrete times, and processing the plurality of three-dimensional electrogram surfaces through time to generate a velocity vector map corresponding at least partially to the 2 D grid.
    Type: Grant
    Filed: December 24, 2018
    Date of Patent: April 20, 2021
    Assignee: Ablacon Inc.
    Inventor: Peter Ruppersberg
  • Patent number: 10983597
    Abstract: The technology disclosed relates to automatically (e.g., programmatically) initializing predictive information for tracking a complex control object (e.g., hand, hand and tool combination, robot end effector) based upon information about characteristics of the object determined from sets of collected observed information. Automated initialization techniques obviate the need for special and often bizarre start-up rituals (place your hands on the screen at the places indicated during a full moon, and so forth) required by conventional techniques. In implementations, systems can refine initial predictive information to reflect an observed condition based on comparison of the observed with an analysis of sets of collected observed information.
    Type: Grant
    Filed: February 28, 2020
    Date of Patent: April 20, 2021
    Assignee: Ultrahaptics IP Two Limited
    Inventor: Kevin A. Horowitz
  • Patent number: 10981065
    Abstract: An example of an information processing apparatus places an object in a virtual space. The information processing apparatus counts, for at least one type of the object, a placement number of the objects placed in the virtual space. The information processing apparatus presents candidates of a clear condition including a condition relating to the object, on the basis of the counted placement number, in a selectable manner for a user. The clear condition is used for determining that a game using the virtual space has been cleared. The information processing apparatus sets a candidate selected by the user, as the clear condition.
    Type: Grant
    Filed: March 27, 2019
    Date of Patent: April 20, 2021
    Assignee: Nintendo Co., Ltd.
    Inventors: Yosuke Oshino, Fumiya Nakano
  • Patent number: 10984586
    Abstract: In some instances, spatial mapping data from one spatial mapping is used to augment the spatial mapping data in another spatial mapping. First and second spatial mapping data is accessed, where both the first and second spatial mapping data overlap in that they both, at least partially, describe the same portion of an environment three-dimensionally. A determination is made as to whether the second spatial mapping data is to augment the first spatial mapping data. If so, then the second spatial mapping data is used to augment the first spatial mapping data. Otherwise, the second spatial mapping data is not used to augment the first spatial mapping data. These determinations may be based, at least in part, on determined quality levels of the first and second spatial mapping data.
    Type: Grant
    Filed: July 27, 2018
    Date of Patent: April 20, 2021
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Raymond Kirk Price, Yuri Pekelny, Michael Bleyer
  • Patent number: 10984582
    Abstract: Systems and methods for rendering vector data in conjunction with a three-dimensional model are provided. In particular, a smooth transparent draping layer can be generated and rendered overlaying the three-dimensional model. The vector data can be texture mapped to the smooth transparent draping layer such that the vector data appears to be located along a surface in the three-dimensional model. The three-dimensional model can be a model of a geographic area and can include terrain geometry that models the terrain of the geographic area and building geometry that models buildings, bridges, and other objects in the geographic area. The smooth transparent draping layer can conform to the surfaces defined by the terrain geometry. The vector data can be texture mapped to the smooth transparent draping layer such that the vector data appears to be located along the surface of the terrain geometry but can be occluded by the building geometry.
    Type: Grant
    Filed: December 20, 2019
    Date of Patent: April 20, 2021
    Assignee: Google LLC
    Inventors: Ryan Styles Overbeck, Janne Kontkanen
  • Patent number: 10984583
    Abstract: Various implementations are disclosed of producing a 3-dimensional model of a scene. Various method, electronic device, or system implementations use RGB-D camera to provide RGB-D video content or periodic aligned RGB images and depth images to localize camera spatial position(s) defined in a three dimensional (3D) coordinate system or reconstruct a 3D virtual representation of a current camera frame in the 3D coordinate system, each in real time.
    Type: Grant
    Filed: February 28, 2019
    Date of Patent: April 20, 2021
    Assignee: Apple Inc.
    Inventor: Maxime Meilland
  • Patent number: 10983201
    Abstract: Techniques are disclosed for real-time mapping in a movable object environment. A system for real-time mapping in a movable object environment, may include at least one movable object including a computing device, a scanning sensor electronically coupled to the computing device, and a positioning sensor electronically coupled to the computing device. The system may further include a client device in communication with the at least one movable object, the client device including a visualization application which is configured to receive point cloud data from the scanning sensor and position data from the positioning sensor, record the point cloud data and the position data to a storage location, generate a real-time visualization of the point cloud data and the position data as it is received, and display the real-time visualization using a user interface provided by the visualization application.
    Type: Grant
    Filed: October 25, 2019
    Date of Patent: April 20, 2021
    Assignee: DJI Technology, Inc.
    Inventors: Alain Pimentel, Kalyani Premji Nirmal, Comran Morshed, Arjun Sukumar Menon, Weifeng Liu
  • Patent number: 10984579
    Abstract: A system and method of playing back 3D animations includes receiving user selection of a 3D file that contains animation parameters of an animated 3D model such as a preset animation or an embedded customized animation and inserting the animated 3D model into a 2D display canvas while preserving the animation parameters of the animated 3D model described in the 3D file. The animated 3D model is played and paused on the 2D display canvas under user control independent of a main thread that enables interaction with and editing of other content besides the animated 3D model in the 2D display. User adjustment of animation parameters of the animated 3D model during playback are received and the animated 3D model with the received user adjusted animation parameters are presented to the 2D display canvas on a display device.
    Type: Grant
    Filed: May 31, 2019
    Date of Patent: April 20, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Aimee Leong, Matt Kernek, Stephanie Horn, Jie Li, Varun Pandey, Mikko Mannisto, Eduardo Lemus Velazquez
  • Patent number: 10984587
    Abstract: Multiple snapshots of a scene are captured within an executing application (e.g., a video game). When each snapshot is captured, associated color values per pixel and a distance or depth value z per pixel are stored. The depth information from the snapshots is accessed, and a point cloud representing the depth information is constructed. A mesh structure is constructed from the point cloud. The light field(s) on the surface(s) of the mesh structure are calculated. A surface light field is represented as a texture. A renderer uses the surface light field with geometry information to reproduce the scene captured in the snapshots. The reproduced scene can be manipulated and viewed from different perspectives.
    Type: Grant
    Filed: June 7, 2019
    Date of Patent: April 20, 2021
    Assignee: NVIDIA Corporation
    Inventors: Dmitry Duka, Rev Lebaredian, Jonathan Small, Ivan Shutov
  • Patent number: 10983770
    Abstract: A computing system may include a computing device configured to build modules of script code into bundles, and a bundler application executable to perform operations comprising: obtaining one or more of the modules of script code that are designated for bundling with one another; organizing the modules of script code into one or more chunks; for each respective chunk of the one or more chunks: (i) determining whether the respective chunk is to be assigned a deterministic chunk identifier or a non-deterministic chunk identifier, and (ii) assigning the respective chunk a chunk identifier as determined, where deterministic chunk identifiers are usable for referencing by additional modules of script code both within and not within in the respective chunk, and where the deterministic chunk identifiers are independent of characteristics of the computing device; and writing the one or more chunks to a bundle.
    Type: Grant
    Filed: June 9, 2020
    Date of Patent: April 20, 2021
    Assignee: ServiceNow, Inc.
    Inventor: Jason Strimpel
  • Patent number: 10983679
    Abstract: A content manipulation application provides a graphical interface for editing graphical content. The graphical interface includes first and second control elements for performing first and second manipulations of the graphical content. If the first control element is selected, the content management application switches the graphical interface to a trackpad mode. The trackpad mode disables the second control element and thereby prevents the second control element from performing the second manipulation. While the graphical interface is in the trackpad mode, the content management application receives an input in an input area that lacks the first control element and performs the first manipulation of the graphical content responsive to receiving the input. Subsequent to the first manipulation being performed, the graphical interface is switched out of the trackpad mode, thereby enabling the second control element to perform the second manipulation.
    Type: Grant
    Filed: October 6, 2017
    Date of Patent: April 20, 2021
    Assignee: ADOBE INC.
    Inventors: Thomas T. Donahue, Richard Sinn, Allan M. Young
  • Patent number: 10984596
    Abstract: Systems and methods are provided for enriching an in-door virtual reality (VR) tour. An exemplary system may include a communication interface configured to receive input from a user, a memory storing computer-readable instructions, and at least one processor coupled to the communication interface and the memory. The computer-readable instructions, when executed by the at least one processor, may cause the at least one processor to perform operations. The operations may include detecting, through the communication interface, a trigger input by the user. In response to the detection of the trigger, the operations may include receiving, through the communication interface, enrichment data input by the user. The operations may also include determining a functional space based on a user indicator representing the user in the in-door VR tour. The operations may further include associating the enrichment data with the functional space.
    Type: Grant
    Filed: May 29, 2019
    Date of Patent: April 20, 2021
    Assignee: KE.COM (BEIJING)TECHNOLOGY CO., LTD.
    Inventors: Yuke Yang, Xing Du
  • Patent number: 10984049
    Abstract: A method, computer readable medium, and system are disclosed for performing traversal stack compression. The method includes traversing a hierarchical data structure having more than two children per node, and during the traversing, creating at least one stack entry, utilizing a processor, where each stack entry contains a plurality of intersected nodes, and adding the at least one stack entry to a compressed traversal stack stored in a memory, utilizing the processor.
    Type: Grant
    Filed: January 25, 2018
    Date of Patent: April 20, 2021
    Assignee: NVIDIA CORPORATION
    Inventors: Henri Johannes Ylitie, Tero Tapani Karras, Samuli Matias Laine
  • Patent number: 10984240
    Abstract: A system for updating a point cloud of an environment having markers for measuring an environment and a method are provided. The system includes a mobile device having a camera. The system further includes one or more processors responsive to executable computer instructions to perform a method comprising capturing one or more images of at least a portion of the environment that include the one or more markers in the one or more images, identifying the one or more markers within the one or more images, comparing the identified one or more markers to a reference system with known coordinates and integrating the one or more images into a point cloud.
    Type: Grant
    Filed: April 8, 2019
    Date of Patent: April 20, 2021
    Assignee: FARO TECHNOLOGIES, INC.
    Inventors: Denis Wohlfeld, Evelyn Schmitz
  • Patent number: 10986325
    Abstract: Scene flow represents the three-dimensional (3D) structure and movement of objects in a video sequence in three dimensions from frame-to-frame and is used to track objects and estimate speeds for autonomous driving applications. Scene flow is recovered by a neural network system from a video sequence captured from at least two viewpoints (e.g., cameras), such as a left-eye and right-eye of a viewer. An encoder portion of the system extracts features from frames of the video sequence. The features are input to a first decoder to predict optical flow and a second decoder to predict disparity. The optical flow represents pixel movement in (x,y) and the disparity represents pixel movement in z (depth). When combined, the optical flow and disparity represent the scene flow.
    Type: Grant
    Filed: September 12, 2019
    Date of Patent: April 20, 2021
    Assignee: NVIDIA Corporation
    Inventors: Deqing Sun, Varun Jampani, Erik Gundersen Learned-Miller, Huaizu Jiang
  • Patent number: 10984144
    Abstract: A data publishing system includes a design server that stores design data, a publishing server that stores published data, which is associated with the design data, and a browsing terminal. A user uses a keyboard and a mouse that are included in the browsing terminal and selects the design data stored in the design server and the published data stored in the publishing server. An arithmetic processing unit causes a monitor to display whether the selected design data and the selected published data match each other.
    Type: Grant
    Filed: May 8, 2019
    Date of Patent: April 20, 2021
    Assignee: HONDA MOTOR CO., LTD.
    Inventor: Yasuaki Hotozuka
  • Patent number: 10980610
    Abstract: Systems, methods, and computer-readable media are provided for robotic surgical device control. A system is provided including a robotic arm, an autosteroscopic display, a user image capture device, an image processor, and a controller. The robotic arm is coupled to a patient image capture device. The autostereoscopic display is configured to display an image of a surgical site obtained from the patient image capture device. The image processor configured to identify a location of at least part of a user in an image obtained from the user image capture device. The controller is configured to, in a first mode, adjust a three dimensional aspect of the image displayed on autostereoscopic display based on the identified location, and, in a second mode, move the robotic arm or instrument based on a relationship between the identified location and the surgical site image.
    Type: Grant
    Filed: May 26, 2017
    Date of Patent: April 20, 2021
    Assignee: Covidien LP
    Inventors: Meir Rosenberg, Dwight Meglan, William Peine, Albert Dvornik
  • Patent number: 10979687
    Abstract: Each of plural devices includes a laser emitter and a camera for detecting reflections of laser light emitted by the device, so that plural of the devices can generate their own depth maps showing images within the field of view of their cameras. The resolution of each depth map may be improved by accessing a data store of prior images of objects and combining the prior images using super-resolution with current images of the depth maps.
    Type: Grant
    Filed: April 3, 2017
    Date of Patent: April 13, 2021
    Assignee: Sony Corporation
    Inventors: Peter Shintani, Jose Omar Gonzalez Hernandez, William Clay, Pablo Antonio Espinosa, Fred Ansfield, Bibhudendu Mohapatra, Keith Resch, Morio Usami
  • Patent number: 10978019
    Abstract: A head mounted display system is switchable between a first-person perspective mode and a third-person perspective mode. The head mounted display system includes a wearable body, a display unit and a processing unit. The display unit is for displaying a scene in the first-person perspective mode or in the third-person perspective mode. The processing unit is configured to generate a switching command in response to an activating command, so as to indicate the display unit to switch from the first-person perspective mode to the third-person perspective mode, or to switch from the third-person perspective mode to the first-person perspective mode, which allows the user get away from a stopping state or a stuck state, or understand a current position or a current state in the virtual environment, which significantly enhances user experience.
    Type: Grant
    Filed: April 15, 2019
    Date of Patent: April 13, 2021
    Assignee: XRSpace CO., LTD.
    Inventor: Wei-Shuo Chen
  • Patent number: 10977267
    Abstract: An approach for transforming a large dataset using user interface-based transformations applied to a sample of the dataset is disclosed. The sample of the large dataset has the same or similar format as the large dataset. A user can quickly apply transformations to the sample dataset using UI-based instructions. The UI-based instructions can be used to create a transformation job that can be configured to run on a backed database, such as a distributed database, to apply the transformations to the large dataset.
    Type: Grant
    Filed: August 11, 2017
    Date of Patent: April 13, 2021
    Assignee: Palantir Technologies Inc.
    Inventors: Gregory O'Connor, Samuel Fendell, Ethan Breder, William Rhyne, Michael Kodiak, Thomas Haynes
  • Patent number: 10974446
    Abstract: Disclosed is a computer-implemented method for determining a boundary representation of the result of a two-axis 3D printing process. The method comprises obtaining a stack of planes, each couple of consecutive planes corresponding to a respective slice of the result of the 3D printing process. The method also comprises, for each couple of consecutive planes: obtaining one or more respective tool trajectories, determining a respective 2D contour corresponding to the one or more tool trajectories. The method also comprises determining a respective extrusion of the respective 2D contour bounded by a second plane of the couple and a first plane of the couple, and forming the boundary representation with the extrusions and portions of the planes. The method improves 3D printing.
    Type: Grant
    Filed: December 19, 2017
    Date of Patent: April 13, 2021
    Assignee: DASSAULT SYSTEMES
    Inventors: Romain Nosenzo, Richard Maisonneuve, Nicolas Montana
  • Patent number: 10977857
    Abstract: Provided are an apparatus and method of three-dimensional reverse modeling of a building structure by using photographic images, and more particularly, to an apparatus and method of three-dimensional reverse modeling of a building structure by using photographic images, in which three-dimensional modeling data of a building structure may be quickly and conveniently reversely modeled by using a plurality of photographic images. According to the apparatus and method of three-dimensional reverse modeling of a building structure by using photographic images, three-dimensional modeling data of a building structure may be reversely modeled by using photographic images of the building structure captured using a camera, at low costs and quickly and easily, thereby remarkably increasing the productivity of the manufacture of a building information model (BIM).
    Type: Grant
    Filed: December 2, 2019
    Date of Patent: April 13, 2021
    Assignee: CUPIX, INC.
    Inventors: SeockHoon Bae, ChangYoon Yang
  • Patent number: 10977856
    Abstract: A computer-implemented technique is described herein for generating a digital representation of real-world surfaces in an environment. The technique involves receiving sensor data captured by one or more depth-sensing devices. The technique then provides a low-detail (LD) representation of surfaces in the physical environment based on the sensor data; that LD representation describes one or more planes in the physical environment. The technique then generates a high-detail (HD) representation of the surfaces based on the sensor data and the LD representation. Finally, the technique provides an output result based on the LD representation and/or the HD representation. According to one illustrative aspect, the technique produces the HD representation such that it is non-duplicative of information that is already present in the LD representation. The technique performs this task by identifying and excluding HD information that is already adequately represented by the LD representation.
    Type: Grant
    Filed: March 29, 2018
    Date of Patent: April 13, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Yuri Pekelny, Oliver Michael Strunk
  • Patent number: 10977860
    Abstract: Hardware tessellation units include a sub-division logic block that comprises hardware logic arranged to perform a sub-division of a patch into two (or more) sub-patches. The hardware tessellation units also include a decision logic block that is configured to determine whether a patch is to be sub-divided or not and one or more hardware elements that control the order in which tessellation occurs. In various examples, this hardware element is a patch stack that operates a first-in-last-out scheme and in other examples, there are one or more selection logic blocks that are configured to receive patch data for more than one patch or sub-patch and output the patch data for a selected one of the received patches or sub-patches.
    Type: Grant
    Filed: April 5, 2019
    Date of Patent: April 13, 2021
    Assignee: Imagination Technologies Limited
    Inventors: Peter Malcolm Lacey, Simon Fenney
  • Patent number: 10977721
    Abstract: Techniques for generating a digital wardrobe are presented herein. A transceiver can be configured to receive a request having a garment identifier and a user identifier. Additionally, an access module can be configured to access a first garment model, access a body model of the user corresponding to the user identifier, and access a second garment model corresponding to the user identifier. Furthermore, a processor can be configured by a garment simulation module to position the body model inside the first garment model and the second garment model, and calculate simulated forces based on the positioning. Moreover, a rendering module can be configured to generate an image of the garment models draped on the body model based on the calculated simulated forces. Subsequently, a display module can be configured to cause presentation of the generated image on a display of a device.
    Type: Grant
    Filed: December 27, 2018
    Date of Patent: April 13, 2021
    Assignee: eBay Inc.
    Inventors: Jonathan Su, Jatin Chhugani, Mihir Naware, Neelakantan Sundaresan
  • Patent number: 10977853
    Abstract: An apparatus and method for compressing ray tracing data prior to transmission between nodes. For example, one embodiment of an apparatus comprises: a first node comprising a first ray tracing engine, the first node communicatively coupled to a second node comprising a second ray tracing engine; first compression circuitry coupled to the first ray tracing engine, the first compression circuitry to perform compression on ray tracing data of the first ray tracing engine to produce a first compressed stream of ray tracing data; and interface circuitry to transmit the first compressed stream of ray tracing data from the first node to the second node.
    Type: Grant
    Filed: February 14, 2020
    Date of Patent: April 13, 2021
    Assignee: Intel Corporation
    Inventors: Ingo Wald, Gabor Liktor, Carsten Benthin, Carson Brownlee, Johannes Guenther, Jefferson D. Amstutz
  • Patent number: 10976817
    Abstract: In one implementation, a method includes: synthesizing an AR/VR content stream by embedding a plurality of glints provided for eye tracking into one or more content frames of the AR/VR content stream; displaying, via the one or more AR/VR displays, the AR/VR content stream to a user of the HMD; obtaining, via the image sensor, light intensity data corresponding to the one or more content frames of the AR/VR content stream that include the plurality of glints, wherein the light intensity data includes a projection of an eye of the user of the HMD having projected thereon the plurality of glints; and determining an orientation of the eye of the user of the HMD based on the light intensity data.
    Type: Grant
    Filed: July 29, 2020
    Date of Patent: April 13, 2021
    Assignee: APPLE INC.
    Inventors: Jae Hwang Lee, Avi Bar-Zeev, Fletcher R. Rothkopf
  • Patent number: 10979487
    Abstract: A method and system for providing an aggregate view of information that a user may need is provided. A desktop assistant system collects information items that a user may need such as scheduling information and recently received messages. The desktop assistant system may also identify documents that the user may need and contacts with whom the user may need to communicate based on analysis of the collected scheduling information and the collected messages. The desktop assistant system then displays indications of the collected scheduling information, the collected messages, the identified documents, and the identified contacts so that the user has an integrated view of the needed information items.
    Type: Grant
    Filed: April 25, 2018
    Date of Patent: April 13, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Edwin R. Burtner, Thomas V. Gruver
  • Patent number: 10979700
    Abstract: Provided is a display control apparatus to perform operations of units including a display control unit configured to display a partial range of the wide visual field image and a control unit. The control unit changes the display range of the wide visual field image by rotating the display range clockwise or counterclockwise around the first axis in response to input of a moving operation in a first direction or in a second direction opposite to the first direction. The control unit changes the display range by rotating the display range in a rotation direction around the first axis in response to input of a moving operation in the first direction, wherein the rotation direction differs based on a positional relationship between a start point of the moving operation and the center position with respect to a axis direction vertical to the first direction.
    Type: Grant
    Filed: March 25, 2019
    Date of Patent: April 13, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Jun Koyama
  • Patent number: 10977773
    Abstract: Techniques of compressing level of detail (LOD) data involve defining a cost metric that predicts how much computing resources are necessary to decode and render a mesh at a given LOD. The cost metric may be optimized by a selection of a LOD reduction process of a plurality of processes at each LOD reduction step. For each process of the plurality of processes, the LOD is reduced according to that process and the resulting reduced LOD is evaluated according to the cost metric. Each such process at that LOD reduction step produces a respective LOD, which includes a mesh, one or more texture atlases, and/or other attributes. The LOD produced by the process having the lowest value of the cost metric at a reduction step is the LOD that is input into the next LOD reduction step.
    Type: Grant
    Filed: February 19, 2019
    Date of Patent: April 13, 2021
    Assignee: Google LLC
    Inventors: Michael Hemmer, Pierre Alliez, Cedric Portaneri
  • Patent number: 10972569
    Abstract: An apparatus for heterogeneous compression of data streams is disclosed. In at least one embodiment, the apparatus includes a sampling module that samples a data stream at one or more intervals to determine a content type for data within the one or more intervals. The apparatus further includes a mapping module that determines whether the content type is linked to a preferred data compression method. The apparatus further includes a processing module that compresses the data within the one or more intervals to produce compressed data using the preferred data compression method in response to determining that the content type is linked to the preferred data compression method. Embodiments of corresponding methods and computer program products are also disclosed.
    Type: Grant
    Filed: April 24, 2017
    Date of Patent: April 6, 2021
    Assignee: International Business Machines Corporation
    Inventors: Avishai H. Hochberg, Hunny W. Kershaw, Mark L. Yakushev