Patents Examined by Mark K. Zimmerman
  • Patent number: 11321918
    Abstract: A computer-implemented method for generating a corresponding 3D mesh representing a 3D object includes transforming an initial three-dimensional mesh into a planar mesh, wherein each vertex or edge of the planar mesh is a transformation of a vertex or edge from the initial three-dimensional mesh; and sampling the planar mesh to generate a plurality of samples such that each sample comprises a three-dimensional coordinate representing a point in a three-dimensional space derived and/or taken directly from the initial three-dimensional mesh, and a coordinate representing a position of the sample relative to other samples; and generating the sampled matrix based on the plurality of samples; and representing the sampled matrix as a corresponding 3D mesh.
    Type: Grant
    Filed: February 26, 2020
    Date of Patent: May 3, 2022
    Assignee: 3SHAPE A/S
    Inventors: Jens Christian Jørgensen, Jens Peter Träff, Alejandro Alonso Diaz
  • Patent number: 11276229
    Abstract: The scale of modeled building objects from collected imagery is determined by identifying architectural elements within building object imagery, determining a scale of the identified architectural elements by matching them to known industry standard architectural element based on dimensional ratio comparisons and deriving an average scaling factor based on scale of the identified architectural elements. A three dimensional model of the building object is scaled according to the average scaling. Scaled architecture elements within a relative error can be used for scaling the model according to an updated scale factor.
    Type: Grant
    Filed: December 18, 2020
    Date of Patent: March 15, 2022
    Assignee: Hover Inc.
    Inventors: Derek Halliday, Antonio Carlos Marques da Silva Junior, Roberto Klein, Adam J. Altman
  • Patent number: 11182960
    Abstract: The system generates real-time augmented reality video for TV broadcast, cinema or video games. The system includes a monoscopic video camera including a body, a stereoscopic video camera, and a processor. The system includes sensors, including multiple non-optical sensors, which provide real-time positioning data defining the 3D position and 3D orientation of the monoscopic video camera, or enable the 3D position and 3D orientation of the monoscopic video camera to be calculated. The processor is configured to use the real-time positioning data automatically to create, recall, render or modify computer generated 3D objects. The processor is configured to determine the 3D position and orientation of the monoscopic video camera with reference to a 3D map of the real-world generated whilst the camera is being used to capture video. The processor is configured to track the scene without a requirement for an initial or prior survey of the scene.
    Type: Grant
    Filed: August 19, 2015
    Date of Patent: November 23, 2021
    Assignee: NCAM TECHNOLOGIES LIMITED
    Inventors: Samuel Boivin, Brice Michoud
  • Patent number: 11157073
    Abstract: A method for calibrating an orientation of an eye-mounted display relative to a user's gaze, preferably performed by a system. The system causes the eye-mounted display to project a calibration image onto the user's retina. The user provides information about a relative orientation between the user's gaze and the calibration image, for example a translation offset or a relative rotation. Based on the received information, an orientation for the eye-mounted display that aligns with the user's gaze is determined. Images to be projected by the eye-mounted display onto the user's retina can be adjusted based on the determined orientation.
    Type: Grant
    Filed: October 4, 2017
    Date of Patent: October 26, 2021
    Assignee: Tectus Corporation
    Inventor: Hansong Zhang
  • Patent number: 11113877
    Abstract: Systems and methods are described for creating three dimensional models of building objects by creating a point cloud from a plurality of input images, defining edges of the building object's surfaces represented by the point cloud, creating simplified geometries of the building object's surfaces and constructing a building model based on the simplified geometries. Input images may include ground, orthographic, or oblique images. The resultant model may be scaled according to correlation with select image types and textured.
    Type: Grant
    Filed: August 11, 2020
    Date of Patent: September 7, 2021
    Assignee: Hover Inc.
    Inventors: Shaohui Sun, Ioannis Pavlidis, Adam J. Altman
  • Patent number: 11107266
    Abstract: An apparatus and method are described for performing a distance test in a ray tracing system. For example, one embodiment of a graphics processing apparatus comprises: a ray tracing traversal/intersection unit to identify two or more ray-surface intersections, each of the ray-surface intersections being assigned a unique hit point identifier (ID); and a distance testing module to disambiguate the order of the ray-surface intersections using the hit point ID if the two or more of the ray-surface intersections share the same distance.
    Type: Grant
    Filed: April 1, 2019
    Date of Patent: August 31, 2021
    Assignee: INTEL CORPORATION
    Inventor: Ingo Wald
  • Patent number: 11094136
    Abstract: A computing system and method to generate an avatar wearing a piece of clothing. Given a generic clothing model acquired for the avatar, the system generates a customized clothing model based on uniformly scaling the generic clothing model according to a size of the avatar, identifies one or more edges or boundaries of the clothing, deforms a clothing mesh of the scaled clothing model at the one or more edges by stretching and/or shrinking the edges, and performs a physical simulation of fitting the deformed clothing model on the avatar to generate a fitted clothing model for the avatar. User interfaces can be optionally provided to interactively adjust the scaling, deforming, and/or physical simulation of the clothing models.
    Type: Grant
    Filed: April 28, 2017
    Date of Patent: August 17, 2021
    Assignee: Linden Research, Inc.
    Inventors: Jeremiah Arthur Grant, Avery Lauren Orman, David Parks, Richard Benjamin Trent Nelson
  • Patent number: 11083552
    Abstract: The invention pertains to a method for realistic visualization of a 3D virtual dental model (1) in a 2D image (20) of a face, the method comprising estimating or assuming a lighting situation in the image of the face, determining boundaries of an inner mouth region in the image, computing, based on the boundaries of the inner mouth region, on a 3D face geometry and on the lighting situation, a shadowing in the inner mouth region, computing a lighting of the dental model (1) based at least on the computed shadowing, and visualizing the dental model (1) and the 2D image (20), wherein at least the inner mouth region in the image is overlaid with a visualization (21) of the dental model having the computed lighting.
    Type: Grant
    Filed: February 19, 2019
    Date of Patent: August 10, 2021
    Assignee: Ivoclar Vivadent AG
    Inventors: Marcel Lancelle, Roland Mörzinger, Nicolas Degen, Gabor Sörös, Bartolovic Nemanja
  • Patent number: 11049319
    Abstract: A method for implementing virtual reality roaming path control includes steps that a tag of a passing grid cell is detected from a start point of the roaming path when a roamer roams in the virtual passage, if the passing grid cell is tagged as an impassable cell, then it is determined to be impassable and another grid cell is selected for re-detection; if the passing grid cell is tagged as a passable cell, then whether the roamer is the preset roaming object is further detected, according to the roaming control label for the passable cell, if not, then it is determined to be impassable and another grid cell is selected for re-detection, if yes, then it is determined to be passable and continued to select the next passing grid cell for detection; and a passable roaming path is generated according to a detection result.
    Type: Grant
    Filed: December 29, 2019
    Date of Patent: June 29, 2021
    Assignee: LESOFT TECHNOLOGY (BEIJING) CO., LTD.
    Inventor: Wei Zheng
  • Patent number: 11043029
    Abstract: A system of virtual reality includes a roaming path control unit, where the roaming path control unit includes a decomposing processing module, a tagging processing module, a setting processing module, a control processing module and a roaming path generating module, where the control processing module is configured to, detect a tag of a passing grid cell from a start point of the roaming path when a roamer roams in the virtual passage, if the passing grid cell is tagged as an impassable cell, then select another grid cell for re-detection; if the passing grid cell is tagged as a passable cell, then further detect whether the roamer is the preset roaming object, according to the roaming control label for the passable cell, if not, then select another grid cell for re-detection, if yes, then determine to be passable and continue to select the next passing grid cell for detection.
    Type: Grant
    Filed: December 29, 2019
    Date of Patent: June 22, 2021
    Assignee: LESOFT TECHNOLOGY (BEIJING) CO., LTD.
    Inventor: Wei Zheng
  • Patent number: 11030823
    Abstract: Improper positioning of architectural features is corrected during construction or reconstruction of a multi-dimensional (e.g., 3D) building model using known architectural dimensions and known relationships to planes (facades). The system identifies architectural elements that have known architectural standard positions relative to planes within the multi-dimensional model. Dimensional measurements of architectural elements in the multi-dimensional model are used to properly position one or more architectural elements relative to associated planes within the multi-dimensional building model. For example, a window position on a 3D building model first façade is moved inward (offset) according to the known relationship of a window (architectural element) being inset relative to a façade (e.g., exterior wall). In addition, a window frame could be repositioned outwardly relative to the same façade plane based on a known relationship of a frame being located on an external surface of the façade (e.g.
    Type: Grant
    Filed: September 23, 2019
    Date of Patent: June 8, 2021
    Assignee: Hover Inc.
    Inventors: Manish Upendran, Adam J. Altman, Derek Halliday
  • Patent number: 11017612
    Abstract: Systems and methods are disclosed for adjusting plane positions in multi-dimensional models. Disclosed is moving planes associated with an architectural element based on detecting edge position(s) for an architectural element relative to a given plane and reconstructing the model based on the adjusted position(s).
    Type: Grant
    Filed: April 10, 2020
    Date of Patent: May 25, 2021
    Assignee: Hover Inc.
    Inventors: Manish Upendran, Adam J. Altman, Derek Halliday
  • Patent number: 11010985
    Abstract: An electronic device is provided. The electronic device includes: an image sensor, a display device, and a processor. The image sensor captures a plurality of object images of a target object on which a first positioning tag, a second positioning tag, and a third positioning tag are disposed. The processor executes an augmented-reality program to perform the following steps: recognizing the first positioning tag, the second positioning tag, and the third positioning tag from each object image; calculating a scale ratio for each dimension of a three-dimensional model according to the positions of the first, second, and third positioning tags; performing an image-scaling process on the three-dimensional model and rendering the scaled three-dimensional model; and overlaying the scaled three-dimensional model on each object image to generate an output image and displaying the output image on the display device.
    Type: Grant
    Filed: August 26, 2019
    Date of Patent: May 18, 2021
    Assignee: QUANTA COMPUTER INC.
    Inventor: Yu-Liang Shih
  • Patent number: 10987587
    Abstract: A system and method for building and rendering in-game objects. In some embodiments, the system includes a plurality of metadata records describing available assets, wherein each metadata record comprises an asset identifier, which identifies an asset, and a property tag. In some embodiments, the system receives the metadata asset record or the asset identified by the metadata asset record from an asset interface to instruct a rendering engine to load the asset identified by the metadata asset record into a 3D environment.
    Type: Grant
    Filed: December 22, 2017
    Date of Patent: April 27, 2021
    Assignee: TAKE-TWO INTERACTIVE SOFTWARE, INC.
    Inventors: Aaron Garbut, Klaas Schilstra, Flavius Alecu, John Whyte
  • Patent number: 10970867
    Abstract: Techniques are described herein that overcome the limitations of conventional techniques by bridging a gap between user interaction with digital content using a computing device and a user's physical environment through use of augmented reality content. In one example, user interaction with augmented reality digital content as part of a live stream of digital images of a user's environment is used to specify a size of an area that is used to filter search results to find a “best fit”. In another example, a geometric shape is used to represent a size and shape of an object included in a digital image (e.g., a two-dimensional digital image). The geometric shape is displayed as augmented reality digital content as part of a live stream of digital images to “assess fit” of the object in the user's physical environment.
    Type: Grant
    Filed: May 13, 2020
    Date of Patent: April 6, 2021
    Assignee: eBay Inc.
    Inventors: Preeti Patil Anadure, Mukul Arora, Ashwin Ganesh Krishnamurthy
  • Patent number: 10923004
    Abstract: An information processing apparatus configured to paste a full-spherical panoramic image along an inner wall of a virtual three-dimensional sphere; calculate an arrangement position for arranging a planar image closer to a center point of the virtual three-dimensional sphere than the inner wall, in such an orientation that a line-of-sight direction from the center point to the inner wall and a perpendicular line of the planar image are parallel to each other, the planar image being obtained by pasting an embedding image to be embedded in the full-spherical panoramic image, on a two-dimensional plane; and display a display image on a display unit. The display image is a two-dimensional image viewed from the center point in the line-of-sight direction in a state in which the full-spherical panoramic image is pasted along the inner wall of the virtual three-dimensional sphere and the planar image is arranged at an arrangement position.
    Type: Grant
    Filed: May 15, 2020
    Date of Patent: February 16, 2021
    Assignee: RICOH COMPANY, LTD.
    Inventor: Taketo Chiba
  • Patent number: 10900201
    Abstract: A display system of a working machine includes: a tilt sensor that detects a pitch angle and a roll angle of a working machine; a calculation unit that calculates a tilting position on polar coordinates that indicates a magnitude and a direction of tilt of the working machine based on the detected pitch angle and roll angle; a display unit that displays various kinds of information; a display processing unit that displays, on a predetermined region on a display screen of the display unit, a monitor-displayed level that performs a polar coordinate display of the tilting position and a marked line indicating a preset magnitude of tilt; and a setting processing unit that performs a setting to change display content of the monitor-displayed level.
    Type: Grant
    Filed: September 30, 2016
    Date of Patent: January 26, 2021
    Assignee: KOMATSU LTD.
    Inventors: Satoru Shintani, Yoshito Kumakura, Daiki Arimatsu
  • Patent number: 10902672
    Abstract: Determining the scale of building objects within collected imagery is determined by identifying architectural elements within stored building object imagery, determining dimensional ratios for the identified architectural elements, matching the identified architectural element to a known industry standard architectural element based on dimensional ratio comparisons and determining a scaling factor of the building object imagery based on relative error to the determined scale of the identified architectural elements. A three dimensional model of the building object constructed from said building object imagery may be scaled by the scaling factor, and dimensions such as measurements for its components determined.
    Type: Grant
    Filed: August 20, 2020
    Date of Patent: January 26, 2021
    Assignee: Hover Inc.
    Inventors: Derek Halliday, Antonio Carlos Marques da Silva, Jr., Roberto Klein, Adam J. Altman
  • Patent number: 10873684
    Abstract: A video display apparatus includes: a tone mapping processor that performs a tone mapping process of converting a luminance of a video by using conversion characteristics according to a maximum luminance of the video; and a display that displays the video that has undergone the tone mapping process. The tone mapping processor switches between a first tone mapping process of dynamically changing the conversion characteristics according to a time-depend change in the maximum luminance of the video and a second tone mapping process that is performed using constant conversion characteristics irrespective of the time-depend change in the maximum luminance of the video. When the tone mapping process used is switched from the second tone mapping process to the first tone mapping process, the conversion characteristics used is changed gradually or stepwise from the constant conversion characteristics to dynamically changing conversion characteristics over a plurality of frames.
    Type: Grant
    Filed: February 26, 2018
    Date of Patent: December 22, 2020
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Masayuki Kozuka, Masaya Yamamoto, Yoshiichiro Kashiwagi, Toshiroh Nishio, Kazuhiko Kouno, Hiroshi Yahata, Takeshi Hirota, Yoshihiro Mori
  • Patent number: 10861224
    Abstract: A system and method is provided for constructing a labeled and dimensioned multi-dimensional (e.g., 3D) building model from building object imagery (e.g., ground-level imagery). The method begins by retrieve building object imagery, the building object imagery collected based on directed capture with a mobile device. The method continues by constructing a scaled multi-dimensional building model, the scale based on sizing of at least one selected architectural feature. The method continues by identifying architectural elements within facades of the multi-dimensional building model. The method continues by determining dimensions of at least one of the architectural elements, the dimensions based on the scale. The method continues by determining dimensions (e.g., area) of at least one of the architectural elements. The method continues by labeling each identified architectural element with at least an identifier and by labeling at least one of the architectural elements with the determined dimensions.
    Type: Grant
    Filed: January 20, 2017
    Date of Patent: December 8, 2020
    Assignee: Hover Inc.
    Inventors: Derek Halliday, Antonio Carlos Marques da Silva Junior, Roberto Klein, Adam J. Altman