Patents Examined by Jed-Justin Imperial
  • Patent number: 11455779
    Abstract: In example embodiments, techniques are provided for visualizing a 3D model in an interactive editing workflow. A user modifies one or more elements of a model of the 3D model, by inserting one or more new elements having geometry, changing the geometry of one or more existing elements and/or deleting one or more existing elements having geometry. An updated view of the 3D model is then rendered to reflect the modification to the one or more elements in part by obtaining, for each new element or changed existing element of the model visible in the view, a polygon mesh that represents geometry of the individual element, obtaining a set of tiles that each include a polygon mesh that represent collective geometry of a set of elements intersecting the tile's volume, displaying the polygon mesh for each new element or changed existing element, and displaying the set of tiles while hiding any deleted or changed existing elements therein.
    Type: Grant
    Filed: September 9, 2020
    Date of Patent: September 27, 2022
    Assignee: Bentley Systems, Incorporated
    Inventor: Paul Connelly
  • Patent number: 11457196
    Abstract: The subject technology selects a set of augmented reality content generators from a plurality of available augmented reality content generator based on metadata associated with each respective augmented reality content generator. The subject technology receives, at a client device, a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator including a 3D effect. The subject technology captures image data and depth data using at least one camera of the client device. The subject technology applies, to the image data and the depth data, the 3D effect based at least in part on the augmented reality content generator.
    Type: Grant
    Filed: August 28, 2020
    Date of Patent: September 27, 2022
    Assignee: Snap Inc.
    Inventors: Kyle Goodrich, Samuel Edward Hare, Maxim Maximov Lazarov, Tony Mathew, Andrew James McPhee, Daniel Moreno, Dhritiman Sagar, Wentao Shang
  • Patent number: 11455748
    Abstract: This method for up-sampling a point cloud representing a 3D object, comprises: —detecting (2) points belonging to at least one under-sampled region of the point cloud on the basis of at least one desirable sampling rate (K); —obtaining (12), for each detected point, an associated tangent plane; —inserting (14) in the point cloud at least one neighboring point of each detected point if a distance between the neighboring point and the tangent plane associated with the detected point is less than a first threshold.
    Type: Grant
    Filed: October 2, 2018
    Date of Patent: September 27, 2022
    Assignee: InterDigital VC Holdings, Inc.
    Inventors: Kangying Cai, Celine Guede, Joan Llach Pinsach, Sebastien Lasserre
  • Patent number: 11449405
    Abstract: An information processing apparatus generates a graph that represents an action of a program. On the graph, an edge represents action contents of a process in an event. Further, two nodes connected by the edge respectively represent a subject and an object of the event. The information processing apparatus outputs the generated graph. Further, the information processing apparatus also alters the generated graph. When an index value of an event satisfies a first predetermined condition which index value is based on the number of occurrences or the frequency of occurrences of the event, the information processing apparatus alters the graph with respect to an edge representing the event.
    Type: Grant
    Filed: March 28, 2018
    Date of Patent: September 20, 2022
    Inventors: Etsuko Ichihara, Yoshiaki Sakae, Kazuhiko Isoyama, Jun Nishioka
  • Patent number: 11380064
    Abstract: An augmented reality (AR) platform supports concurrent operation of multiple AR applications developed by third-party software developers. The AR platform may include an application programming interface (API) that third-party software developers can use to integrate features of the AR platform into the overall user experience of their AR applications. The AR platform includes a feature set having a variety of AR-specific features that interact with and are accessible to the AR applications or AR layers that define a collection of AR content.
    Type: Grant
    Filed: March 24, 2020
    Date of Patent: July 5, 2022
    Assignee: YouAR INC.
    Inventors: Oliver Clayton Daniels, David Morris Daniels, Raymond Victor Di Carlo, Luke T. Hartwig, Paul Issac Thomas
  • Patent number: 11376100
    Abstract: Embodiments are provided for digital dental modeling. One method embodiment includes receiving a three-dimensional data set including a first jaw and a second jaw of a three-dimensional digital dental model and receiving a two-dimensional data set corresponding to at least a portion of the first jaw and the second jaw. The method includes mapping two-dimensional data of the two-dimensional data set to the three-dimensional digital dental model by transforming a coordinate system of the two-dimensional data to a coordinate system of the three-dimensional data set. The method includes positioning the first jaw with respect to the second jaw based on the two-dimensional data mapped to the three-dimensional data set. The method includes using at least a portion of the two-dimensional data mapped to the three-dimensional data set as a target of movement of the first jaw with respect to the second jaw in the three-dimensional digital dental model.
    Type: Grant
    Filed: December 23, 2020
    Date of Patent: July 5, 2022
    Assignee: Align Technology, Inc.
    Inventors: Anatoliy Boltunov, Yury Brailov, Fedor Chelnokov, Roman Roschin, David Mason
  • Patent number: 11367252
    Abstract: A system, method and computer program product are provided for generating line-of-sight information using imagery. In some aspects, the method includes receiving a raster image depicting at least one object in a region of interest, and measuring a shadow of the at least one object in the raster image. The method also includes determining an angle of the sun from the shadow of the at least one object, and creating a plurality of virtual shadows for the at least one object using the angle of the sun. The method further includes generating line-of-sight information for the at least one object based on an intersection of the plurality of virtual shadows with objects in the region of interest.
    Type: Grant
    Filed: October 1, 2020
    Date of Patent: June 21, 2022
    Assignee: HERE GLOBAL B.V.
    Inventor: Priyank Sameer
  • Patent number: 11361486
    Abstract: A visualization combination engine may be used to combine a first data visualization based on a first data set with a second data visualization based on a second data set. The combination process may be initiated by, for example, clicking and dragging the first data visualization onto the second data visualization. The visualization combination engine may create the combined data visualization without requiring the user to manually combine the first and second data sets. The combination may be carried out by identifying a key that is common between the two data sets and combining the first and second data sets into a combined data set based on the key, and then creating the combined data visualization based on the combined data set. One or more cues may be used during the process to provide helpful information and/or allow user selection of the properties of the combined data visualization.
    Type: Grant
    Filed: September 12, 2019
    Date of Patent: June 14, 2022
    Assignee: Domo, Inc.
    Inventors: Gary Gibb, Alan Winters, Mardell Cheney, Ben Green, Chris Willis
  • Patent number: 11361484
    Abstract: Systems and methods for segmenting scan data are disclosed. The methods include receiving scan data representing a plurality of points in an environment associated with a ground surface and one or more objects, and creating a graph from the scan data. The graph includes a plurality of vertices corresponding to the plurality of points. The method further includes assigning a unary potential to each of the plurality of vertices that is a cost of assigning that vertex to a ground label or a non-ground label, and assigning a pairwise potential to each pair of neighboring vertices in the graph that is the cost of assigning different labels to neighboring vertices. The methods include using the unary potentials and the pairwise potentials to identify labels for each of the plurality of points, and segmenting the scan data to identify points associated with the ground based on the identified labels.
    Type: Grant
    Filed: December 4, 2020
    Date of Patent: June 14, 2022
    Assignee: Argo AI, LLC
    Inventor: John Peterson
  • Patent number: 11341715
    Abstract: A method, a system, a device, and a computer readable storage medium for video reconstruction are disclosed. The method includes: obtaining an image combination of multi-angle free-perspective video frames, parameter data corresponding to the image combinations of the video frames, and position information of a virtual viewpoint based on a user interaction; selecting texture images and depth maps of corresponding groups in the image combinations of the video frames at a time moment of the user interaction according to a preset rule and based on the position information of the virtual viewpoint and the parameter data corresponding to the image combinations of the video frames; and combining and rendering the texture images and the depth maps of the corresponding groups based on the position information of the virtual viewpoint and parameter data corresponding to the depth maps and the texture images of the corresponding groups to obtain a reconstructed image.
    Type: Grant
    Filed: March 5, 2020
    Date of Patent: May 24, 2022
    Assignee: Alibaba Group Holding Limited
    Inventor: Xiaojie Sheng
  • Patent number: 11321893
    Abstract: A method of simulating avatar attention in a virtual environment includes, for a given avatar within the environment; periodically calculating the respective interest value of a plurality of elements in the virtual environment in dependence upon one or more factors, where at least one of said factors is evaluated responsive to a relationship between the respective element and that given avatar, selecting the element with the highest calculated interest value, and causing a representation of that given avatar's eyes to point at the selected element within the virtual environment.
    Type: Grant
    Filed: February 6, 2018
    Date of Patent: May 3, 2022
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Elisheva Shapiro, Mandana Jenabzadeh
  • Patent number: 11315337
    Abstract: A method for managing, by an electronic device, content in an augmented reality (AR) system is provided. The method includes identifying a digital artefact that is used by a first application of an electronic device, executing and displaying an image capturing application to capture images, displaying the digital artefact on a captured image which includes an object of a real world where the digital artefact is displayed on or around the object, and, while the digital artefact is displayed, receiving an user input on at least one of the digital artefact or the object for performing an action associated with the digital artefact.
    Type: Grant
    Filed: May 23, 2019
    Date of Patent: April 26, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Debayan Mukherjee, Swadha Jaiswal, Saumitri Choudhury, Preksha Shukla, Veethika Mishra, Shivi Pal, Suresh Kumar Gara, Nitish Gupta
  • Patent number: 11308687
    Abstract: A device can receive an identification of an environmental model associated with a user navigating a website and receive an identification of an item model associated with an item requested by the user to be shown in connection with the environmental model on a client device. The environmental model could be a body model of the user or of another force like wind. The item model models how the item would move in connection with the environmental model. The device identifies movement associated with the environmental model and generates, based on the environmental model and the item model, frames each having respective data of the item as it would move on the environmental model according to the movement to yield movement key attributes. The device transmits the movement key attributes to the client device for rendering using a client device rendering engine.
    Type: Grant
    Filed: March 29, 2019
    Date of Patent: April 19, 2022
    Assignee: Amazon Technologies, Inc.
    Inventors: Nancy Yi Liang, Matthew Keith Miller, Gabriel J. Zimmerman, Jennifer M. Lin
  • Patent number: 11308679
    Abstract: The technique of this disclosure suppresses a reduction in visibility of a predetermined object in virtual viewpoint image data. An image processing apparatus includes: an image capturing information acquisition unit configured to acquire image capturing information indicating a position and orientation of each of a plurality of image capturing apparatuses; an object information acquisition unit configured to acquire object information indicating a position and orientation of an object to be captured by the image capturing apparatuses, the object having a specific viewing angle; and a determination unit configured to determine, based on the acquired image capturing information and the position and orientation of the object indicated by the acquired object information, an image to be used for generating a virtual viewpoint image according to a position and orientation of a virtual viewpoint among a plurality of images based on capturing by the image capturing apparatuses.
    Type: Grant
    Filed: May 29, 2020
    Date of Patent: April 19, 2022
    Inventor: Daichi Adachi
  • Patent number: 11302073
    Abstract: Method for texturing a 3D model of at least one scene (5), comprising: a) the meshing with surface elements (50; 55) of a point cloud (45) representing the scene, so as to generate the 3D model, each surface element representing an area of the scene, b) the unfolding of the 3D model for obtaining a 2D model formed of a plane mesh (60a; 60b) formed of polygons (65), each surface element corresponding to a single polygon, and vice versa, and c) for at least one, preferably all the surface elements, iv) the identification, from an image bank (40a; 40b), of the images representing the area of the scene and which have been acquired by a camera the image plane (72a-b) of which has a normal direction, in the corresponding acquisition position, forming an angle (?a-b) less than 10°, preferably less than 5°, better less than 3° with a direction normal (70) to the face of the surface element, v) the selection of an image (40a-b) from the identified images, and, vi) the association of a texture property with a corresp
    Type: Grant
    Filed: October 3, 2019
    Date of Patent: April 12, 2022
    Inventors: Guy Perazio, Jose Peral, Serge Valcke, Luc Chambaud
  • Patent number: 11288868
    Abstract: Disclosed herein is a simulated reality (SR) display system with an adjustable perspective. A simulated reality display system with an adaptable user space can receive a real world layout corresponding to a physical space in which the SR environment will be displayed to the user. Using the real world layout, a default user space can be adapted to conform to one or more aspects of the physical space forming an adjusted user space. Assets of an SR layer can be repositioned relative to the adjusted user space, with the SR layer defining a layout of a plurality of assets in the SR environment. The SR environment can be displayed on the display device, in accordance with the SR layer, allowing the user to safely move around the user space to explore the SR environment without undesirable interactions with the one or more aspects of the physical space.
    Type: Grant
    Filed: July 27, 2020
    Date of Patent: March 29, 2022
    Assignee: Foretell Studios, LLC
    Inventors: Howard Olah-Reiken, Lyron L. Bentovim
  • Patent number: 11270115
    Abstract: In one aspect, a headset may include at least one processor, at least one transparent display accessible to the at least one processor, and storage accessible to the at least one processor. The storage may include instructions executable by the at least one processor to detect an indication accompanying audio video (AV) content, with the indication associated with augmented reality (AR) content. The AR content may be different from the AV content but associated with the AV content. The instructions may also be executable to transmit a request for the AR content, receive the AR content, and present the AR content on the at least one transparent display.
    Type: Grant
    Filed: November 18, 2019
    Date of Patent: March 8, 2022
    Assignee: Lenovo (Singapore) Pte. Ltd.
    Inventor: Allen Wayne Richey
  • Patent number: 11250643
    Abstract: A method for providing a virtual exhibition space by using a 2.5-dimensionalization is provided.
    Type: Grant
    Filed: November 6, 2020
    Date of Patent: February 15, 2022
    Inventors: Chi Hyung Park, Dong Ree Kim, Nam Hyun Kim, In Je Cho
  • Patent number: 11250641
    Abstract: Mating virtual objects in virtual reality environment, involves generating a bounding box having a plurality of faces corresponding to a plurality of exterior surfaces of a subject virtual object. A spatial mesh corresponding to surfaces of the real world environment is generated. A magnetic mate is generated to initially align a bounding box first face to a first spatial mesh surface. A shadow mate is provided between a bounding box second face and a second spatial mesh surface, by projecting a virtual ray from the subject virtual object bounding box second face toward the second spatial mesh surface, determining a mate point corresponding to an intersection of the virtual ray and the second spatial mesh surface, and displaying a mating button in the virtual reality environment at the mate point.
    Type: Grant
    Filed: February 5, 2020
    Date of Patent: February 15, 2022
    Assignee: Dassault Systemes SolidWorks Corporation
    Inventors: Yun Li, Yaqin Huang, Eric Hasan
  • Patent number: 11238834
    Abstract: A method for adjusting image includes determining, from a background image, a background sub-image corresponding to a foreground sub-image. The foreground sub-image is within a first range of a foreground image, the background image is an image of an external environment, and the foreground image is an image produced by a display device. The method also includes determining a first image attribute of the background sub-image; and adjusting the foreground sub-image based on at least the first image attribute.
    Type: Grant
    Filed: January 9, 2020
    Date of Patent: February 1, 2022
    Inventor: Xiaofei Ding