Patents Examined by Mark K. Zimmerman
  • Patent number: 11113877
    Abstract: Systems and methods are described for creating three dimensional models of building objects by creating a point cloud from a plurality of input images, defining edges of the building object's surfaces represented by the point cloud, creating simplified geometries of the building object's surfaces and constructing a building model based on the simplified geometries. Input images may include ground, orthographic, or oblique images. The resultant model may be scaled according to correlation with select image types and textured.
    Type: Grant
    Filed: August 11, 2020
    Date of Patent: September 7, 2021
    Assignee: Hover Inc.
    Inventors: Shaohui Sun, Ioannis Pavlidis, Adam J. Altman
  • Patent number: 11107266
    Abstract: An apparatus and method are described for performing a distance test in a ray tracing system. For example, one embodiment of a graphics processing apparatus comprises: a ray tracing traversal/intersection unit to identify two or more ray-surface intersections, each of the ray-surface intersections being assigned a unique hit point identifier (ID); and a distance testing module to disambiguate the order of the ray-surface intersections using the hit point ID if the two or more of the ray-surface intersections share the same distance.
    Type: Grant
    Filed: April 1, 2019
    Date of Patent: August 31, 2021
    Assignee: INTEL CORPORATION
    Inventor: Ingo Wald
  • Patent number: 11094136
    Abstract: A computing system and method to generate an avatar wearing a piece of clothing. Given a generic clothing model acquired for the avatar, the system generates a customized clothing model based on uniformly scaling the generic clothing model according to a size of the avatar, identifies one or more edges or boundaries of the clothing, deforms a clothing mesh of the scaled clothing model at the one or more edges by stretching and/or shrinking the edges, and performs a physical simulation of fitting the deformed clothing model on the avatar to generate a fitted clothing model for the avatar. User interfaces can be optionally provided to interactively adjust the scaling, deforming, and/or physical simulation of the clothing models.
    Type: Grant
    Filed: April 28, 2017
    Date of Patent: August 17, 2021
    Assignee: Linden Research, Inc.
    Inventors: Jeremiah Arthur Grant, Avery Lauren Orman, David Parks, Richard Benjamin Trent Nelson
  • Patent number: 11083552
    Abstract: The invention pertains to a method for realistic visualization of a 3D virtual dental model (1) in a 2D image (20) of a face, the method comprising estimating or assuming a lighting situation in the image of the face, determining boundaries of an inner mouth region in the image, computing, based on the boundaries of the inner mouth region, on a 3D face geometry and on the lighting situation, a shadowing in the inner mouth region, computing a lighting of the dental model (1) based at least on the computed shadowing, and visualizing the dental model (1) and the 2D image (20), wherein at least the inner mouth region in the image is overlaid with a visualization (21) of the dental model having the computed lighting.
    Type: Grant
    Filed: February 19, 2019
    Date of Patent: August 10, 2021
    Assignee: Ivoclar Vivadent AG
    Inventors: Marcel Lancelle, Roland Mörzinger, Nicolas Degen, Gabor Sörös, Bartolovic Nemanja
  • Patent number: 11049319
    Abstract: A method for implementing virtual reality roaming path control includes steps that a tag of a passing grid cell is detected from a start point of the roaming path when a roamer roams in the virtual passage, if the passing grid cell is tagged as an impassable cell, then it is determined to be impassable and another grid cell is selected for re-detection; if the passing grid cell is tagged as a passable cell, then whether the roamer is the preset roaming object is further detected, according to the roaming control label for the passable cell, if not, then it is determined to be impassable and another grid cell is selected for re-detection, if yes, then it is determined to be passable and continued to select the next passing grid cell for detection; and a passable roaming path is generated according to a detection result.
    Type: Grant
    Filed: December 29, 2019
    Date of Patent: June 29, 2021
    Assignee: LESOFT TECHNOLOGY (BEIJING) CO., LTD.
    Inventor: Wei Zheng
  • Patent number: 11043029
    Abstract: A system of virtual reality includes a roaming path control unit, where the roaming path control unit includes a decomposing processing module, a tagging processing module, a setting processing module, a control processing module and a roaming path generating module, where the control processing module is configured to, detect a tag of a passing grid cell from a start point of the roaming path when a roamer roams in the virtual passage, if the passing grid cell is tagged as an impassable cell, then select another grid cell for re-detection; if the passing grid cell is tagged as a passable cell, then further detect whether the roamer is the preset roaming object, according to the roaming control label for the passable cell, if not, then select another grid cell for re-detection, if yes, then determine to be passable and continue to select the next passing grid cell for detection.
    Type: Grant
    Filed: December 29, 2019
    Date of Patent: June 22, 2021
    Assignee: LESOFT TECHNOLOGY (BEIJING) CO., LTD.
    Inventor: Wei Zheng
  • Patent number: 11030823
    Abstract: Improper positioning of architectural features is corrected during construction or reconstruction of a multi-dimensional (e.g., 3D) building model using known architectural dimensions and known relationships to planes (facades). The system identifies architectural elements that have known architectural standard positions relative to planes within the multi-dimensional model. Dimensional measurements of architectural elements in the multi-dimensional model are used to properly position one or more architectural elements relative to associated planes within the multi-dimensional building model. For example, a window position on a 3D building model first façade is moved inward (offset) according to the known relationship of a window (architectural element) being inset relative to a façade (e.g., exterior wall). In addition, a window frame could be repositioned outwardly relative to the same façade plane based on a known relationship of a frame being located on an external surface of the façade (e.g.
    Type: Grant
    Filed: September 23, 2019
    Date of Patent: June 8, 2021
    Assignee: Hover Inc.
    Inventors: Manish Upendran, Adam J. Altman, Derek Halliday
  • Patent number: 11017612
    Abstract: Systems and methods are disclosed for adjusting plane positions in multi-dimensional models. Disclosed is moving planes associated with an architectural element based on detecting edge position(s) for an architectural element relative to a given plane and reconstructing the model based on the adjusted position(s).
    Type: Grant
    Filed: April 10, 2020
    Date of Patent: May 25, 2021
    Assignee: Hover Inc.
    Inventors: Manish Upendran, Adam J. Altman, Derek Halliday
  • Patent number: 11010985
    Abstract: An electronic device is provided. The electronic device includes: an image sensor, a display device, and a processor. The image sensor captures a plurality of object images of a target object on which a first positioning tag, a second positioning tag, and a third positioning tag are disposed. The processor executes an augmented-reality program to perform the following steps: recognizing the first positioning tag, the second positioning tag, and the third positioning tag from each object image; calculating a scale ratio for each dimension of a three-dimensional model according to the positions of the first, second, and third positioning tags; performing an image-scaling process on the three-dimensional model and rendering the scaled three-dimensional model; and overlaying the scaled three-dimensional model on each object image to generate an output image and displaying the output image on the display device.
    Type: Grant
    Filed: August 26, 2019
    Date of Patent: May 18, 2021
    Assignee: QUANTA COMPUTER INC.
    Inventor: Yu-Liang Shih
  • Patent number: 10987587
    Abstract: A system and method for building and rendering in-game objects. In some embodiments, the system includes a plurality of metadata records describing available assets, wherein each metadata record comprises an asset identifier, which identifies an asset, and a property tag. In some embodiments, the system receives the metadata asset record or the asset identified by the metadata asset record from an asset interface to instruct a rendering engine to load the asset identified by the metadata asset record into a 3D environment.
    Type: Grant
    Filed: December 22, 2017
    Date of Patent: April 27, 2021
    Assignee: TAKE-TWO INTERACTIVE SOFTWARE, INC.
    Inventors: Aaron Garbut, Klaas Schilstra, Flavius Alecu, John Whyte
  • Patent number: 10970867
    Abstract: Techniques are described herein that overcome the limitations of conventional techniques by bridging a gap between user interaction with digital content using a computing device and a user's physical environment through use of augmented reality content. In one example, user interaction with augmented reality digital content as part of a live stream of digital images of a user's environment is used to specify a size of an area that is used to filter search results to find a “best fit”. In another example, a geometric shape is used to represent a size and shape of an object included in a digital image (e.g., a two-dimensional digital image). The geometric shape is displayed as augmented reality digital content as part of a live stream of digital images to “assess fit” of the object in the user's physical environment.
    Type: Grant
    Filed: May 13, 2020
    Date of Patent: April 6, 2021
    Assignee: eBay Inc.
    Inventors: Preeti Patil Anadure, Mukul Arora, Ashwin Ganesh Krishnamurthy
  • Patent number: 10923004
    Abstract: An information processing apparatus configured to paste a full-spherical panoramic image along an inner wall of a virtual three-dimensional sphere; calculate an arrangement position for arranging a planar image closer to a center point of the virtual three-dimensional sphere than the inner wall, in such an orientation that a line-of-sight direction from the center point to the inner wall and a perpendicular line of the planar image are parallel to each other, the planar image being obtained by pasting an embedding image to be embedded in the full-spherical panoramic image, on a two-dimensional plane; and display a display image on a display unit. The display image is a two-dimensional image viewed from the center point in the line-of-sight direction in a state in which the full-spherical panoramic image is pasted along the inner wall of the virtual three-dimensional sphere and the planar image is arranged at an arrangement position.
    Type: Grant
    Filed: May 15, 2020
    Date of Patent: February 16, 2021
    Assignee: RICOH COMPANY, LTD.
    Inventor: Taketo Chiba
  • Patent number: 10902672
    Abstract: Determining the scale of building objects within collected imagery is determined by identifying architectural elements within stored building object imagery, determining dimensional ratios for the identified architectural elements, matching the identified architectural element to a known industry standard architectural element based on dimensional ratio comparisons and determining a scaling factor of the building object imagery based on relative error to the determined scale of the identified architectural elements. A three dimensional model of the building object constructed from said building object imagery may be scaled by the scaling factor, and dimensions such as measurements for its components determined.
    Type: Grant
    Filed: August 20, 2020
    Date of Patent: January 26, 2021
    Assignee: Hover Inc.
    Inventors: Derek Halliday, Antonio Carlos Marques da Silva, Jr., Roberto Klein, Adam J. Altman
  • Patent number: 10900201
    Abstract: A display system of a working machine includes: a tilt sensor that detects a pitch angle and a roll angle of a working machine; a calculation unit that calculates a tilting position on polar coordinates that indicates a magnitude and a direction of tilt of the working machine based on the detected pitch angle and roll angle; a display unit that displays various kinds of information; a display processing unit that displays, on a predetermined region on a display screen of the display unit, a monitor-displayed level that performs a polar coordinate display of the tilting position and a marked line indicating a preset magnitude of tilt; and a setting processing unit that performs a setting to change display content of the monitor-displayed level.
    Type: Grant
    Filed: September 30, 2016
    Date of Patent: January 26, 2021
    Assignee: KOMATSU LTD.
    Inventors: Satoru Shintani, Yoshito Kumakura, Daiki Arimatsu
  • Patent number: 10873684
    Abstract: A video display apparatus includes: a tone mapping processor that performs a tone mapping process of converting a luminance of a video by using conversion characteristics according to a maximum luminance of the video; and a display that displays the video that has undergone the tone mapping process. The tone mapping processor switches between a first tone mapping process of dynamically changing the conversion characteristics according to a time-depend change in the maximum luminance of the video and a second tone mapping process that is performed using constant conversion characteristics irrespective of the time-depend change in the maximum luminance of the video. When the tone mapping process used is switched from the second tone mapping process to the first tone mapping process, the conversion characteristics used is changed gradually or stepwise from the constant conversion characteristics to dynamically changing conversion characteristics over a plurality of frames.
    Type: Grant
    Filed: February 26, 2018
    Date of Patent: December 22, 2020
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Masayuki Kozuka, Masaya Yamamoto, Yoshiichiro Kashiwagi, Toshiroh Nishio, Kazuhiko Kouno, Hiroshi Yahata, Takeshi Hirota, Yoshihiro Mori
  • Patent number: 10861224
    Abstract: A system and method is provided for constructing a labeled and dimensioned multi-dimensional (e.g., 3D) building model from building object imagery (e.g., ground-level imagery). The method begins by retrieve building object imagery, the building object imagery collected based on directed capture with a mobile device. The method continues by constructing a scaled multi-dimensional building model, the scale based on sizing of at least one selected architectural feature. The method continues by identifying architectural elements within facades of the multi-dimensional building model. The method continues by determining dimensions of at least one of the architectural elements, the dimensions based on the scale. The method continues by determining dimensions (e.g., area) of at least one of the architectural elements. The method continues by labeling each identified architectural element with at least an identifier and by labeling at least one of the architectural elements with the determined dimensions.
    Type: Grant
    Filed: January 20, 2017
    Date of Patent: December 8, 2020
    Assignee: Hover Inc.
    Inventors: Derek Halliday, Antonio Carlos Marques da Silva Junior, Roberto Klein, Adam J. Altman
  • Patent number: 10853649
    Abstract: Systems and methods for alerting a user to safety hazards in real-world while the user is wearing a Head-Mounted Display (HMD). In some embodiments, an Information Handling System (IHS) may include: a processor; and a memory coupled to the processor, the memory having program instructions stored thereon that, upon execution by the processor, cause the IHS to: receive an image during execution of a xR application displayed to a user wearing a Head-Mounted Display (HMD) coupled to the IHS; detect an object in the image; associate the object with a landmark selected among a plurality of landmarks usable by the xR application to determine a position of the HMD; and provide to the user, via the HMD, a safety instruction related to the object in response to a distance between the HMD and the selected landmark meeting a distance threshold.
    Type: Grant
    Filed: August 27, 2018
    Date of Patent: December 1, 2020
    Assignee: Dell Products, L.P.
    Inventors: Vivek Viswanathan Iyer, Michael S. Gatson
  • Patent number: 10847121
    Abstract: A projector includes a display controller that scrolls image data within liquid crystal panels in accordance with operation accepted via an operation/display panel in a case where a display section displays the image data and scrolls the image data that forms combined image data within liquid crystal panels in accordance with operation accepted by the operation/display panel in a case where the display section displays the combined image data. A scroll range over which the image data that forms the combined image data is scrolled in the case where the display section displays the combined image data is wider than a scroll range over which the image data is scrolled in the case where the display section displays the image data.
    Type: Grant
    Filed: June 29, 2018
    Date of Patent: November 24, 2020
    Assignee: SEIKO EPSON CORPORATION
    Inventor: Kensuke Kida
  • Patent number: 10776995
    Abstract: The introduced method and system use a 4-dimensional (4D) light field as a background of a scene, instead of 2D background image. Realizing computing a light field takes tremendous amounts of processing power, data storage and time (even with the currently available hardware), the introduced method and system compute and store the light field before rendering a scene. To reduce the time storing and accessing the light field during the rendering process, the introduced method and system also uses a modified video codec to compress and decompress the light field as 2D images.
    Type: Grant
    Filed: July 31, 2018
    Date of Patent: September 15, 2020
    Assignee: Nvidia Corporation
    Inventor: Daniel Seibert
  • Patent number: 10776999
    Abstract: A system and method is provided for generating textured 3D building models from ground-level imagery. Ground-level images for the sides/corners of building objects are collected for identification of key architectural features, corresponding key façade geometry planes, and generation of a 3D building façade geometry. The 3D building model is properly geo-positioned, scaled and textured.
    Type: Grant
    Filed: September 2, 2016
    Date of Patent: September 15, 2020
    Assignee: Hover Inc.
    Inventors: Shaohui Sun, Ioannis Pavlidis, Adam J. Altman