Patents Examined by Mark K. Zimmerman
-
Patent number: 11321918Abstract: A computer-implemented method for generating a corresponding 3D mesh representing a 3D object includes transforming an initial three-dimensional mesh into a planar mesh, wherein each vertex or edge of the planar mesh is a transformation of a vertex or edge from the initial three-dimensional mesh; and sampling the planar mesh to generate a plurality of samples such that each sample comprises a three-dimensional coordinate representing a point in a three-dimensional space derived and/or taken directly from the initial three-dimensional mesh, and a coordinate representing a position of the sample relative to other samples; and generating the sampled matrix based on the plurality of samples; and representing the sampled matrix as a corresponding 3D mesh.Type: GrantFiled: February 26, 2020Date of Patent: May 3, 2022Assignee: 3SHAPE A/SInventors: Jens Christian Jørgensen, Jens Peter Träff, Alejandro Alonso Diaz
-
Patent number: 11276229Abstract: The scale of modeled building objects from collected imagery is determined by identifying architectural elements within building object imagery, determining a scale of the identified architectural elements by matching them to known industry standard architectural element based on dimensional ratio comparisons and deriving an average scaling factor based on scale of the identified architectural elements. A three dimensional model of the building object is scaled according to the average scaling. Scaled architecture elements within a relative error can be used for scaling the model according to an updated scale factor.Type: GrantFiled: December 18, 2020Date of Patent: March 15, 2022Assignee: Hover Inc.Inventors: Derek Halliday, Antonio Carlos Marques da Silva Junior, Roberto Klein, Adam J. Altman
-
Patent number: 11182960Abstract: The system generates real-time augmented reality video for TV broadcast, cinema or video games. The system includes a monoscopic video camera including a body, a stereoscopic video camera, and a processor. The system includes sensors, including multiple non-optical sensors, which provide real-time positioning data defining the 3D position and 3D orientation of the monoscopic video camera, or enable the 3D position and 3D orientation of the monoscopic video camera to be calculated. The processor is configured to use the real-time positioning data automatically to create, recall, render or modify computer generated 3D objects. The processor is configured to determine the 3D position and orientation of the monoscopic video camera with reference to a 3D map of the real-world generated whilst the camera is being used to capture video. The processor is configured to track the scene without a requirement for an initial or prior survey of the scene.Type: GrantFiled: August 19, 2015Date of Patent: November 23, 2021Assignee: NCAM TECHNOLOGIES LIMITEDInventors: Samuel Boivin, Brice Michoud
-
Patent number: 11157073Abstract: A method for calibrating an orientation of an eye-mounted display relative to a user's gaze, preferably performed by a system. The system causes the eye-mounted display to project a calibration image onto the user's retina. The user provides information about a relative orientation between the user's gaze and the calibration image, for example a translation offset or a relative rotation. Based on the received information, an orientation for the eye-mounted display that aligns with the user's gaze is determined. Images to be projected by the eye-mounted display onto the user's retina can be adjusted based on the determined orientation.Type: GrantFiled: October 4, 2017Date of Patent: October 26, 2021Assignee: Tectus CorporationInventor: Hansong Zhang
-
Patent number: 11113877Abstract: Systems and methods are described for creating three dimensional models of building objects by creating a point cloud from a plurality of input images, defining edges of the building object's surfaces represented by the point cloud, creating simplified geometries of the building object's surfaces and constructing a building model based on the simplified geometries. Input images may include ground, orthographic, or oblique images. The resultant model may be scaled according to correlation with select image types and textured.Type: GrantFiled: August 11, 2020Date of Patent: September 7, 2021Assignee: Hover Inc.Inventors: Shaohui Sun, Ioannis Pavlidis, Adam J. Altman
-
Patent number: 11107266Abstract: An apparatus and method are described for performing a distance test in a ray tracing system. For example, one embodiment of a graphics processing apparatus comprises: a ray tracing traversal/intersection unit to identify two or more ray-surface intersections, each of the ray-surface intersections being assigned a unique hit point identifier (ID); and a distance testing module to disambiguate the order of the ray-surface intersections using the hit point ID if the two or more of the ray-surface intersections share the same distance.Type: GrantFiled: April 1, 2019Date of Patent: August 31, 2021Assignee: INTEL CORPORATIONInventor: Ingo Wald
-
Patent number: 11094136Abstract: A computing system and method to generate an avatar wearing a piece of clothing. Given a generic clothing model acquired for the avatar, the system generates a customized clothing model based on uniformly scaling the generic clothing model according to a size of the avatar, identifies one or more edges or boundaries of the clothing, deforms a clothing mesh of the scaled clothing model at the one or more edges by stretching and/or shrinking the edges, and performs a physical simulation of fitting the deformed clothing model on the avatar to generate a fitted clothing model for the avatar. User interfaces can be optionally provided to interactively adjust the scaling, deforming, and/or physical simulation of the clothing models.Type: GrantFiled: April 28, 2017Date of Patent: August 17, 2021Assignee: Linden Research, Inc.Inventors: Jeremiah Arthur Grant, Avery Lauren Orman, David Parks, Richard Benjamin Trent Nelson
-
Patent number: 11083552Abstract: The invention pertains to a method for realistic visualization of a 3D virtual dental model (1) in a 2D image (20) of a face, the method comprising estimating or assuming a lighting situation in the image of the face, determining boundaries of an inner mouth region in the image, computing, based on the boundaries of the inner mouth region, on a 3D face geometry and on the lighting situation, a shadowing in the inner mouth region, computing a lighting of the dental model (1) based at least on the computed shadowing, and visualizing the dental model (1) and the 2D image (20), wherein at least the inner mouth region in the image is overlaid with a visualization (21) of the dental model having the computed lighting.Type: GrantFiled: February 19, 2019Date of Patent: August 10, 2021Assignee: Ivoclar Vivadent AGInventors: Marcel Lancelle, Roland Mörzinger, Nicolas Degen, Gabor Sörös, Bartolovic Nemanja
-
Patent number: 11049319Abstract: A method for implementing virtual reality roaming path control includes steps that a tag of a passing grid cell is detected from a start point of the roaming path when a roamer roams in the virtual passage, if the passing grid cell is tagged as an impassable cell, then it is determined to be impassable and another grid cell is selected for re-detection; if the passing grid cell is tagged as a passable cell, then whether the roamer is the preset roaming object is further detected, according to the roaming control label for the passable cell, if not, then it is determined to be impassable and another grid cell is selected for re-detection, if yes, then it is determined to be passable and continued to select the next passing grid cell for detection; and a passable roaming path is generated according to a detection result.Type: GrantFiled: December 29, 2019Date of Patent: June 29, 2021Assignee: LESOFT TECHNOLOGY (BEIJING) CO., LTD.Inventor: Wei Zheng
-
Patent number: 11043029Abstract: A system of virtual reality includes a roaming path control unit, where the roaming path control unit includes a decomposing processing module, a tagging processing module, a setting processing module, a control processing module and a roaming path generating module, where the control processing module is configured to, detect a tag of a passing grid cell from a start point of the roaming path when a roamer roams in the virtual passage, if the passing grid cell is tagged as an impassable cell, then select another grid cell for re-detection; if the passing grid cell is tagged as a passable cell, then further detect whether the roamer is the preset roaming object, according to the roaming control label for the passable cell, if not, then select another grid cell for re-detection, if yes, then determine to be passable and continue to select the next passing grid cell for detection.Type: GrantFiled: December 29, 2019Date of Patent: June 22, 2021Assignee: LESOFT TECHNOLOGY (BEIJING) CO., LTD.Inventor: Wei Zheng
-
Patent number: 11030823Abstract: Improper positioning of architectural features is corrected during construction or reconstruction of a multi-dimensional (e.g., 3D) building model using known architectural dimensions and known relationships to planes (facades). The system identifies architectural elements that have known architectural standard positions relative to planes within the multi-dimensional model. Dimensional measurements of architectural elements in the multi-dimensional model are used to properly position one or more architectural elements relative to associated planes within the multi-dimensional building model. For example, a window position on a 3D building model first façade is moved inward (offset) according to the known relationship of a window (architectural element) being inset relative to a façade (e.g., exterior wall). In addition, a window frame could be repositioned outwardly relative to the same façade plane based on a known relationship of a frame being located on an external surface of the façade (e.g.Type: GrantFiled: September 23, 2019Date of Patent: June 8, 2021Assignee: Hover Inc.Inventors: Manish Upendran, Adam J. Altman, Derek Halliday
-
Patent number: 11017612Abstract: Systems and methods are disclosed for adjusting plane positions in multi-dimensional models. Disclosed is moving planes associated with an architectural element based on detecting edge position(s) for an architectural element relative to a given plane and reconstructing the model based on the adjusted position(s).Type: GrantFiled: April 10, 2020Date of Patent: May 25, 2021Assignee: Hover Inc.Inventors: Manish Upendran, Adam J. Altman, Derek Halliday
-
Patent number: 11010985Abstract: An electronic device is provided. The electronic device includes: an image sensor, a display device, and a processor. The image sensor captures a plurality of object images of a target object on which a first positioning tag, a second positioning tag, and a third positioning tag are disposed. The processor executes an augmented-reality program to perform the following steps: recognizing the first positioning tag, the second positioning tag, and the third positioning tag from each object image; calculating a scale ratio for each dimension of a three-dimensional model according to the positions of the first, second, and third positioning tags; performing an image-scaling process on the three-dimensional model and rendering the scaled three-dimensional model; and overlaying the scaled three-dimensional model on each object image to generate an output image and displaying the output image on the display device.Type: GrantFiled: August 26, 2019Date of Patent: May 18, 2021Assignee: QUANTA COMPUTER INC.Inventor: Yu-Liang Shih
-
Patent number: 10987587Abstract: A system and method for building and rendering in-game objects. In some embodiments, the system includes a plurality of metadata records describing available assets, wherein each metadata record comprises an asset identifier, which identifies an asset, and a property tag. In some embodiments, the system receives the metadata asset record or the asset identified by the metadata asset record from an asset interface to instruct a rendering engine to load the asset identified by the metadata asset record into a 3D environment.Type: GrantFiled: December 22, 2017Date of Patent: April 27, 2021Assignee: TAKE-TWO INTERACTIVE SOFTWARE, INC.Inventors: Aaron Garbut, Klaas Schilstra, Flavius Alecu, John Whyte
-
Patent number: 10970867Abstract: Techniques are described herein that overcome the limitations of conventional techniques by bridging a gap between user interaction with digital content using a computing device and a user's physical environment through use of augmented reality content. In one example, user interaction with augmented reality digital content as part of a live stream of digital images of a user's environment is used to specify a size of an area that is used to filter search results to find a “best fit”. In another example, a geometric shape is used to represent a size and shape of an object included in a digital image (e.g., a two-dimensional digital image). The geometric shape is displayed as augmented reality digital content as part of a live stream of digital images to “assess fit” of the object in the user's physical environment.Type: GrantFiled: May 13, 2020Date of Patent: April 6, 2021Assignee: eBay Inc.Inventors: Preeti Patil Anadure, Mukul Arora, Ashwin Ganesh Krishnamurthy
-
Patent number: 10923004Abstract: An information processing apparatus configured to paste a full-spherical panoramic image along an inner wall of a virtual three-dimensional sphere; calculate an arrangement position for arranging a planar image closer to a center point of the virtual three-dimensional sphere than the inner wall, in such an orientation that a line-of-sight direction from the center point to the inner wall and a perpendicular line of the planar image are parallel to each other, the planar image being obtained by pasting an embedding image to be embedded in the full-spherical panoramic image, on a two-dimensional plane; and display a display image on a display unit. The display image is a two-dimensional image viewed from the center point in the line-of-sight direction in a state in which the full-spherical panoramic image is pasted along the inner wall of the virtual three-dimensional sphere and the planar image is arranged at an arrangement position.Type: GrantFiled: May 15, 2020Date of Patent: February 16, 2021Assignee: RICOH COMPANY, LTD.Inventor: Taketo Chiba
-
Patent number: 10900201Abstract: A display system of a working machine includes: a tilt sensor that detects a pitch angle and a roll angle of a working machine; a calculation unit that calculates a tilting position on polar coordinates that indicates a magnitude and a direction of tilt of the working machine based on the detected pitch angle and roll angle; a display unit that displays various kinds of information; a display processing unit that displays, on a predetermined region on a display screen of the display unit, a monitor-displayed level that performs a polar coordinate display of the tilting position and a marked line indicating a preset magnitude of tilt; and a setting processing unit that performs a setting to change display content of the monitor-displayed level.Type: GrantFiled: September 30, 2016Date of Patent: January 26, 2021Assignee: KOMATSU LTD.Inventors: Satoru Shintani, Yoshito Kumakura, Daiki Arimatsu
-
Patent number: 10902672Abstract: Determining the scale of building objects within collected imagery is determined by identifying architectural elements within stored building object imagery, determining dimensional ratios for the identified architectural elements, matching the identified architectural element to a known industry standard architectural element based on dimensional ratio comparisons and determining a scaling factor of the building object imagery based on relative error to the determined scale of the identified architectural elements. A three dimensional model of the building object constructed from said building object imagery may be scaled by the scaling factor, and dimensions such as measurements for its components determined.Type: GrantFiled: August 20, 2020Date of Patent: January 26, 2021Assignee: Hover Inc.Inventors: Derek Halliday, Antonio Carlos Marques da Silva, Jr., Roberto Klein, Adam J. Altman
-
Patent number: 10873684Abstract: A video display apparatus includes: a tone mapping processor that performs a tone mapping process of converting a luminance of a video by using conversion characteristics according to a maximum luminance of the video; and a display that displays the video that has undergone the tone mapping process. The tone mapping processor switches between a first tone mapping process of dynamically changing the conversion characteristics according to a time-depend change in the maximum luminance of the video and a second tone mapping process that is performed using constant conversion characteristics irrespective of the time-depend change in the maximum luminance of the video. When the tone mapping process used is switched from the second tone mapping process to the first tone mapping process, the conversion characteristics used is changed gradually or stepwise from the constant conversion characteristics to dynamically changing conversion characteristics over a plurality of frames.Type: GrantFiled: February 26, 2018Date of Patent: December 22, 2020Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.Inventors: Masayuki Kozuka, Masaya Yamamoto, Yoshiichiro Kashiwagi, Toshiroh Nishio, Kazuhiko Kouno, Hiroshi Yahata, Takeshi Hirota, Yoshihiro Mori
-
Patent number: 10861224Abstract: A system and method is provided for constructing a labeled and dimensioned multi-dimensional (e.g., 3D) building model from building object imagery (e.g., ground-level imagery). The method begins by retrieve building object imagery, the building object imagery collected based on directed capture with a mobile device. The method continues by constructing a scaled multi-dimensional building model, the scale based on sizing of at least one selected architectural feature. The method continues by identifying architectural elements within facades of the multi-dimensional building model. The method continues by determining dimensions of at least one of the architectural elements, the dimensions based on the scale. The method continues by determining dimensions (e.g., area) of at least one of the architectural elements. The method continues by labeling each identified architectural element with at least an identifier and by labeling at least one of the architectural elements with the determined dimensions.Type: GrantFiled: January 20, 2017Date of Patent: December 8, 2020Assignee: Hover Inc.Inventors: Derek Halliday, Antonio Carlos Marques da Silva Junior, Roberto Klein, Adam J. Altman