Patents Assigned to Unity IPR ApS
  • Patent number: 11951390
    Abstract: A method of rendering a virtual environment is disclosed. First application data is received. The first application data includes first graph data. The first graph data corresponds to a first state of an application. Second application data is received after the first application data. The second application data corresponds to a second state of the application. The first application data and the second application data are analyzed to determine a change in the first graph data associated with the second application data. An island subgraph within the first graph data that includes the change is determined. Second graph data is generated for the second state. The generating of the second graph data includes partially reconstructing the first graph data. The partial reconstructing includes rebuilding the determined island subgraph. The generated second graph data is communicated for rendering of the virtual environment in the second state.
    Type: Grant
    Filed: June 7, 2021
    Date of Patent: April 9, 2024
    Assignee: Unity IPR ApS
    Inventors: Janus Lynggaard Thorborg, Toulouse de Margerie, Wayne Johnson
  • Patent number: 11900528
    Abstract: A method of rendering a view is disclosed. Three occlusion planes associated with an interior cavity of a three-dimensional object included in the view are created. The three occlusion planes are positioned based on a camera position and orientation. Any objects or parts of objects that are in a line of sight between the camera and any one of the three occlusion planes are culled. The view is rendered from the perspective of the camera.
    Type: Grant
    Filed: May 27, 2021
    Date of Patent: February 13, 2024
    Assignee: Unity IPR ApS
    Inventors: Andrew Peter Maneri, Donnavon Troy Webb, Jonathan Randall Newberry
  • Patent number: 11900233
    Abstract: In example embodiments, a method of interactive imitation learning method is disclosed. An input is received from an input device. The input includes data describing a first set of example actions defining a behavior for a virtual character. Inverse reinforcement learning is used to estimate a reward function for the set of example actions. The reward function and the set of example actions is used as input to a reinforcement learning model to train a machine learning agent to mimic the behavior in a training environment. Based on a measure of failure of the training of the machine learning agent reaching a threshold, the training of the machine learning agent is paused to request a second set of example actions from the input device. The second set of example actions is used in addition to the first set of example actions to estimate a new reward function.
    Type: Grant
    Filed: May 26, 2022
    Date of Patent: February 13, 2024
    Assignee: Unity IPR ApS
    Inventors: Arthur William Juliani, Jr., Mohamed Marwan A. Mattar
  • Patent number: 11893416
    Abstract: A job scheduler system includes one or more hardware processors, a memory including a job group queue stored in the memory, and a job scheduler engine configured to create a first job group in the job group queue, the first job group includes a generation counter having an initial value, receive a first request to steal the first job group, determine a state of the first job group based at least in part on the generation counter, the state indicating that the first job group is available to steal, based on the determining the state of the first job group, atomically increment the generation counter, thereby making the first job group unavailable for stealing, and alter an execution order of the first job group ahead of at least one other job group in the job group queue.
    Type: Grant
    Filed: March 23, 2022
    Date of Patent: February 6, 2024
    Assignee: Unity IPR ApS
    Inventor: Benoit Sevigny
  • Patent number: 11887229
    Abstract: A method of populating a digital environment with digital content is disclosed. Environment data describing the digital environment is accessed. Populator data describing a populator digital object is accessed. The populator data includes semantic data describing the populator digital object. The populator digital object is placed within the digital environment. A semantic map representation of the populator digital object is generated. The semantic map representation is divided into a plurality of cells. A target cell of the plurality of cells is selected as a placeholder in the digital environment for a digital object that is optionally subsequently instantiated. The selecting of the target cell is based on an analysis of the environment data, the populator data, and the semantic map representation. Placeholder data is recorded in the semantic map representation. The placeholder data includes properties corresponding to the digital object that is optionally subsequently instantiated.
    Type: Grant
    Filed: December 22, 2022
    Date of Patent: January 30, 2024
    Assignee: Unity IPR ApS
    Inventors: Gregory Lionel Xavier Jean Palmaro, Charles Janusz Migos, Gerald James Williams Orban, Pierre-Luc Loyer, Dominic Laflamme, Sylvio Herve Drouin
  • Patent number: 11863863
    Abstract: A method of determining a suggested digital object to place into a 3D environment is disclosed. Scene data within a frustum volume of a camera within a 3D environment is determined. The scene data includes a set of digital objects that are located within the frustum volume. A set of traits is determined based on the scene data. At least one suggested digital object is suggested for placing into the 3D environment based on a correlation between the suggested digital object and the set of traits.
    Type: Grant
    Filed: July 22, 2021
    Date of Patent: January 2, 2024
    Assignee: Unity IPR ApS
    Inventors: Gregory Lionel Xavier Jean Palmaro, Charles Janusz Migos, Gerald James William Orban
  • Patent number: 11786823
    Abstract: A method for optimizing a computer-implemented game for a target metric is disclosed. Based on a detecting that an optimization point has been reached during a runtime of the computer game, user data, game state data, and personalized gaming experience (PGE) question data is communicated to a PGE server. The PGE question data is linked to the optimization point. An answer corresponding to the PGE question data is received from the PGE server. The answer is selected from a plurality of answers linked to the optimization point based on an application of a machine-learned model to the user data, game state data, and PGE question data. The received answer is implemented within the computer-implemented game.
    Type: Grant
    Filed: May 17, 2022
    Date of Patent: October 17, 2023
    Assignee: Unity IPR ApS
    Inventors: Kaj Mikael Björklund, Mikko Juhani Lehtinen, Kaisa Hillervo Salakka, Pavel Selin, Daniel Zautner
  • Patent number: 11763427
    Abstract: A method of intelligently transforming a digital asset for a target environment is disclosed. Asset data describing the digital asset is received. The received asset data is analyzed to determine a classification type for the digital asset. A database is communicated with to request additional data associated with the determined classification type. The additional data includes semantic data associated with the classification type. The additional data is compared to the received asset data. The comparing includes determining missing data and conflicting data. The missing data includes data from the additional data which is absent from the asset data. The missing data is added to the asset data.
    Type: Grant
    Filed: March 31, 2021
    Date of Patent: September 19, 2023
    Assignee: Unity IPR ApS
    Inventors: Gregory Lionel Xavier Jean Palmaro, Charles Janusz Migos, Patrick Gustaevel, Gerald James William Orban
  • Patent number: 11694382
    Abstract: A method of generating or modifying poses in an animation of a character are disclosed. Variable numbers and types of supplied inputs are combined into a single input. The variable numbers and types of supplied inputs correspond to one or more effector constraints for one or more joints of the character. The single input is transformed into a pose embedding. The pose embedding includes a machine-learned representation of the single input. The pose embedding is expanded into a pose representation output. The pose representation output includes local rotation data and global position data for the one or more joints of the character.
    Type: Grant
    Filed: May 20, 2021
    Date of Patent: July 4, 2023
    Assignee: Unity IPR ApS
    Inventors: Florent Benjamin Bocquelet, Dominic Laflamme, Boris Oreshkin
  • Patent number: 11676355
    Abstract: A method of merging distant virtual spaces is disclosed. Data describing an environment surrounding a MR merging device is received. A first slice plane is generated, positioned, and displayed within the environment. A second MR merging device is connective with in a second environment. Data describing inbound content from the second MR merging device is received. Content data is sent from the MR merging device to the second MR merging device. The inbound content data is processed and displayed on the first slice plane.
    Type: Grant
    Filed: November 4, 2021
    Date of Patent: June 13, 2023
    Assignee: Unity IPR ApS
    Inventor: Gregory Lionel Xavier Jean Palmaro
  • Patent number: 11660538
    Abstract: A method for automatically connecting game items for sharing by a plurality of game systems is disclosed. A first game system is added to a computer-implemented game. The first game system is associated with a first game system definition. The first game system definition corresponding to a first game object. The first game system is automatically connected to a second game system. The automatic connecting includes, at least: identifying a correspondence between the first game system definition and a second game system definition, the second game system definition being associated with the second game system, the second game system definition corresponding to a second game object; and preventing a change to the first game object during runtime of the computer-implemented game based on a detection that the change to the first game object would violate a rule associated with the second game system definition.
    Type: Grant
    Filed: September 21, 2020
    Date of Patent: May 30, 2023
    Assignee: Unity IPR ApS
    Inventors: Ming Zhu, Benan Arigil
  • Patent number: 11631216
    Abstract: A method of rendering an image of an environment is disclosed. Environment data for the environment is accessed. The environment data corresponds to a frame of a video. A plurality of subframes associated with the frame is determined. An angle for each of the plurality of subframes is determined. One or more lights corresponding to the environment are selected. For each light of the one or more lights, a shadow map is generated. The shadow map corresponds to a subframe of the plurality of subframes based on a frustum view oriented at the angle determined for the subframe. The image of the environment is rendered. The rendering includes using the generated shadow map for each light of the one or more lights.
    Type: Grant
    Filed: May 19, 2021
    Date of Patent: April 18, 2023
    Assignee: Unity IPR ApS
    Inventors: Jean-Philippe Leroux, Yohann Christophe Vaast
  • Patent number: 11562517
    Abstract: A method of populating a digital environment with digital content is disclosed. Environment data describing the digital environment is accessed. Populator data describing a populator digital object is accessed. The populator data includes semantic data describing the populator digital object. The populator digital object is placed within the digital environment. A semantic map representation of the populator digital object is generated. The semantic map representation is divided into a plurality of cells. A target cell of the plurality of cells is selected as a placeholder in the digital environment for a digital object that is optionally subsequently instantiated. The selecting of the target cell is based on an analysis of the environment data, the populator data, and the semantic map representation. Placeholder data is recorded in the semantic map representation. The placeholder data includes properties corresponding to the digital object that is optionally subsequently instantiated.
    Type: Grant
    Filed: April 21, 2021
    Date of Patent: January 24, 2023
    Assignee: Unity IPR ApS
    Inventors: Gregory Lionel Xavier Jean Palmaro, Charles Janusz Migos, Gerald James William Orban, Pierre-Luc Loyer, Dominic Laflamme, Sylvio Herve Drouin
  • Patent number: 11524241
    Abstract: A method of improving game development is disclosed. A game model graph of a video game is created or modified using visual scripting nodes. The game model graph represents one or more game systems and/or one or more economies. The nodes are linked to game resources from the video game. Player profiles describing a plurality of different player types are accessed to be used during a simulation of the game model graph. One or more additional simulations are performed. Each of the one or more additional simulations includes executing the game model graph using the player profiles and the game resources. Data is extracted from the one or more additional simulations to determine behavior of the one or more game systems, the one or more game economies, and/or the resources within the video game over time and across the player types.
    Type: Grant
    Filed: October 26, 2021
    Date of Patent: December 13, 2022
    Assignee: Unity IPR ApS
    Inventors: Kaisa Hillervo Salakka, Dominik Trnecka, Charles Janusz Migos, Morgane Mendonça Santos, Tuomas Juhani Harju, Ruoyu Sun, Janne Mikael Kopponen, Robert Gabriel Walter
  • Patent number: 11508116
    Abstract: There is described herein systems and methods for camera colliders and shot composition preservation within a 3D virtual environment that prevent a virtual procedural camera from getting stuck behind an object, or penetrating into an object, when filming a subject, while at the same time also maintaining the screen composition of the subject in the camera shot.
    Type: Grant
    Filed: July 27, 2020
    Date of Patent: November 22, 2022
    Assignee: Unity IPR ApS
    Inventors: Adam Myhill, Gregory Labute
  • Patent number: 11468626
    Abstract: There is described herein systems and methods for camera colliders and shot composition preservation within a 3D virtual environment that prevent a virtual procedural camera from getting stuck behind an object, or penetrating into an object, when filming a subject, while at the same time also maintaining the screen composition of the subject in the camera shot.
    Type: Grant
    Filed: July 27, 2020
    Date of Patent: October 11, 2022
    Assignee: Unity IPR ApS
    Inventors: Adam Myhill, Gregory Labute
  • Patent number: 11426657
    Abstract: A method of retargeting camera motion is disclosed. Data is received that describes a position of a target along a target path. Data is received that describes a position and an orientation of a first camera along a first camera path wherein the first camera is filming the target. A second camera path is computed, the second path corresponding to a second camera. The second camera path corresponds to the first camera path with one or more exceptions. The one or more exceptions include one or more of modification of orientation data corresponding to the second camera path to place the target at the center of a camera screen associated with the second camera and removing of a camera rotation roll for the second camera. A difference is computed between the first camera path and the second camera path. The computed difference is applied to a third camera path.
    Type: Grant
    Filed: July 30, 2020
    Date of Patent: August 30, 2022
    Assignee: Unity IPR ApS
    Inventor: Gregory Labute
  • Patent number: 11406901
    Abstract: A method for tracking game asset locations is disclosed. Content is created for an application using a first asset. The first asset includes asset data that describes at least a part of the content associated with the asset. The asset data is placed within one or more files within a location within one or more memories. A catalog associated with the application is created on the server. A catalog entry is created for the first asset. The catalog entry includes an address that uniquely identifies the first asset. A request is received from the application for asset data associated with the first asset, the request including the address. The address and the catalog are used to determine location data associated with the address. The determined location data is used to retrieve the asset data at the determined location. The retrieved asset data is returned to the application.
    Type: Grant
    Filed: October 7, 2020
    Date of Patent: August 9, 2022
    Assignee: Unity IPR ApS
    Inventors: Joachim Christoph Ante, Stephen Joseph Palmer, Paul Emile Burslem, William David Ramsour, Ryan Caltabiano, Joseph Franklin Scheinberg
  • Patent number: 11403802
    Abstract: Herein is presented a light-weight, high-quality texture synthesis algorithm that generalizes to other applications. We utilize an optimal transport optimization process within a bottleneck layer of an auto-encoder, achieving quality and flexibility on par with expensive back-propagation based neural texture synthesis methods, but at interactive rates. In addition to superior synthesis quality, our statistically motivated approach generalizes better to other special case texture synthesis problems such as Style Transfer, Inverse-Texture Synthesis, Texture Mixing, Multi-Scale Texture Synthesis, Structured Image Hybrids and Texture Painting. We treat the texture synthesis problem as the optimal transport between Probably Density Function of the deep neural activation vectors of the image being synthesized and the exemplar texture.
    Type: Grant
    Filed: June 4, 2021
    Date of Patent: August 2, 2022
    Assignee: Unity IPR ApS
    Inventor: Eric Andrew Risser
  • Patent number: 11380073
    Abstract: A method of aligning a digital model of a structure with a displayed portion of the structure within a video stream is disclosed. An approximate position of the camera device in the digital model is determined. A position and an orientation are determined for a plurality of digital surfaces within the digital model visible from the approximate position of the camera device. A position and an orientation of a plurality of object surfaces visible in a video stream are determined. A 3D translation, a 3D scale, and a 3D rotation that maximize an alignment of the position and orientation of the plurality of digital surfaces with the position and orientation of the plurality of object surfaces are determined. The 3D translation, the 3D scale, and the 3D rotation are applied to the digital model and the digital model is displayed contemporaneously with a display of the video stream.
    Type: Grant
    Filed: February 3, 2021
    Date of Patent: July 5, 2022
    Assignee: Unity IPR ApS
    Inventor: Francis Ruben Malka