Patents Assigned to UNITY TECHNOLOGIES SF
  • Patent number: 11403801
    Abstract: An animation system wherein a machine learning model is adopted to generate animated facial actions based on parameters obtained from a live actor. Specifically, the anatomical structure such as a facial muscle topology and a skull surface that are specific to the live actor may be used. A muscle structure of simplified “pseudo” muscles that approximate the actual muscle topology but with reduced degree of freedom is determined to improve computational efficiency.
    Type: Grant
    Filed: October 23, 2020
    Date of Patent: August 2, 2022
    Assignee: UNITY TECHNOLOGIES SF
    Inventor: Byung Kuk Choi
  • Patent number: 11403775
    Abstract: An active marker apparatus is provided for securely affixing active markers to a wearable article of an object in a performance capture system. The active marker light components coupled to a strand, are inserted into a receptacle to position the active marker light components onto the wearable article. A gap is provided in a chamber between the active marker light component and an interior surface of a protrusion portion of the receptacle. At least a section of the protrusion portion permits light emitted from the active marker light component into the chamber, to diffuse in a manner that allows the light to be easily detected by a camera in the live action scene. Each active marker light component is locked into place in a respective receptacle by one or more channels that receive the strand. A cap fitting may further assist in securing the receptacle to the wearable article and optionally aid in visual detection of the receptacle.
    Type: Grant
    Filed: November 30, 2020
    Date of Patent: August 2, 2022
    Assignee: UNITY TECHNOLOGIES SF
    Inventors: Dejan Momcilovic, Jake Botting
  • Patent number: 11403883
    Abstract: The present description relates to light patterns used in a live action scene of a visual production to encode information associated with objects in the scene, such as movement and position of the objects. A data capture system is enabled to differentiate between various groups of active markers attached to the objects in the scene. The groups of active markers emit particular wavelengths in strobing patterns predefined for the various groups. In some implementations, the groups are instructed to emit its assigned signature light pattern through a signal controller transmitting an initial key signature predefined for the group, followed by pattern signals to a control unit. The data representing the pattern is captured in illuminated and blank frames. Frames showing the light pattern are analyzed to extract information about the groups of active markers, such as distinguishing the groups and identifying the objects to which they are attached.
    Type: Grant
    Filed: January 29, 2021
    Date of Patent: August 2, 2022
    Assignee: UNITY TECHNOLOGIES SF
    Inventors: Dejan Momcilovic, Jake Botting
  • Patent number: 11393149
    Abstract: An animation system wherein scanned facial expressions are processed to form muscle models that can be used to generate expressions based on specification of a strain vector and a control vector of the muscle model.
    Type: Grant
    Filed: September 28, 2020
    Date of Patent: July 19, 2022
    Assignee: Unity Technologies SF
    Inventors: Byung Kuk Choi, Gergely Klár
  • Patent number: 11393151
    Abstract: A combustion simulation system is provided. The combustion simulation system can be performed using a computing device operated by a computer user or artist. The computer-implemented method of generating one or more visual representations of a combustion even is provided. The method includes simulating the combustion event, which transforms combustion reactants into combustion products, the combustion event occurring at a reference pressure, automatically determining values of combustion properties, the values of the combustion properties being calculated as a function of a nonzero pressure field, and generating the one or more visual representations of the combustion event based on the values of combustion properties.
    Type: Grant
    Filed: October 21, 2020
    Date of Patent: July 19, 2022
    Assignee: Unity Technologies SF
    Inventors: Alexey Stomakhin, Ken Museth
  • Patent number: 11392731
    Abstract: A combustion simulation system is provided. The combustion simulation system can be performed using a computing device operated by a computer user or artist. The computer-implemented method of simulating a combustion process includes receiving a set of data representing a fluid flow. The fluid flow can include combustion precursors. The method includes simulating a chemical reaction representing simulated combustion of these precursors generating combustion byproducts. The method can include determining a change in temperature of the combustion byproducts due to the chemical reaction, determining a change in molar mass of the combustion byproducts due to the chemical reaction, determining a divergence of the combustion byproducts based on a combination of the change in the temperature and the change in molar mass, and generating data structures of the simulated combustion based on values of the fluid flow.
    Type: Grant
    Filed: October 21, 2020
    Date of Patent: July 19, 2022
    Assignee: Unity Technologies SF
    Inventors: Ken Museth, John Edholm
  • Patent number: 11393155
    Abstract: In an image processing system, an image insertion is to be included onto, or relative to, a first and second frame, each depicting images of a set of objects of a geometric model. A point association is determined for a depicted object that is depicted in both the first frame and the second frame, representing reference coordinates in a virtual scene space of a first location on the depicted object independent of at least one position change and a mapping of a first image location in the first image to where the first location appears in the first image. A corresponding location in the second image is determined based on where the first location on the depicted object appears according to the reference coordinate in the virtual scene space and a second image location on the second image where the first location appears in the second image.
    Type: Grant
    Filed: October 11, 2021
    Date of Patent: July 19, 2022
    Assignee: Unity Technologies SF
    Inventor: Peter M. Hillman
  • Patent number: 11393180
    Abstract: A request is received to replicate an object in a scene description. A first data structure associating the object with object instances is generated to produce the object instances in the scene description, with each instance corresponding to a position that an instance of the object is to appear in the scene. The first data structure includes a first set of characteristics of the object instances that includes the position. A selection of an object instance and an instruction to customize a characteristic of the object instance is received. A customized characteristic of the object instance is produced by generation of a second data structure associating the customized characteristic with the first data structure. The object instances are rendered such that the customized characteristic of the second data structure supersedes the characteristic of the object in the first data structure.
    Type: Grant
    Filed: October 22, 2020
    Date of Patent: July 19, 2022
    Assignee: Unity Technologies SF
    Inventors: Nicholas S. Shore, Oliver M. Castle
  • Patent number: 11393150
    Abstract: An animation system wherein scanned facial expressions are processed to form muscle models that can be used to generate expressions based on specification of a strain vector and a control vector of the muscle model.
    Type: Grant
    Filed: January 20, 2021
    Date of Patent: July 19, 2022
    Assignee: Unity Technologies SF
    Inventors: Byung Kuk Choi, Gergely Klár
  • Patent number: 11386605
    Abstract: An animation system is provided for generating an animation control rig configured to manipulate a skeleton of an animated object. A partition separation process enables software changes to be inserted into uncompiled computer code associated with the animation control rig. Analysis of the uncompiled computer code is implemented relative to a performance metric. Based on the analysis in view of the performance matric, one or more partitions are determined in the uncompiled computer code to partition the code into separate code blocks. The uncompiled code is separated at the partition and updated with the software change. The updated code is compiled to generate the animation control rig.
    Type: Grant
    Filed: August 3, 2021
    Date of Patent: July 12, 2022
    Assignee: UNITY TECHNOLOGIES SF
    Inventors: Thomas Stevenson, Edward Sun
  • Patent number: 11380048
    Abstract: A computer-implemented method for digital processing is provided. A set of tristimulus values representing a first color in a color space are received. A first representation of a first spectral curve corresponding to the first color is determined, where the first spectral curve is within a gamut of solid reflectances. A second representation of a second spectral curve corresponding to the first color is determined where the second spectral curve contains at least one reflectance wavelength outside the gamut of solid reflectances. Based on selection criteria, the first representation or the second representation is selected. The selected representation is then applied during digital processing.
    Type: Grant
    Filed: December 18, 2020
    Date of Patent: July 5, 2022
    Assignee: Unity Technologies SF
    Inventor: Alexander Wilkie
  • Patent number: 11380136
    Abstract: The present description relates to light patterns used in a live action scene of a visual production to encode information associated with objects in the scene, such as movement and position of the objects. A data capture system includes active markers that emit light of a particular wavelength in predefined strobing patterns. In some implementations, the active markers are instructed to emit an assigned signature pattern of light through a signal controller sending signals to a control unit. Various components are synchronized such that pulsing of light corresponds to time slices and particular frames captured by the performance capture system. The data representing the pattern is embedded in illuminated and blank frames. Frames showing the light pattern are analyzed to extract information about the active markers, such as identification of the active markers and objects to which they are attached.
    Type: Grant
    Filed: December 2, 2021
    Date of Patent: July 5, 2022
    Assignee: UNITY TECHNOLOGIES SF
    Inventors: Dejan Momcilovic, Jake Botting
  • Publication number: 20220198713
    Abstract: The present description relates relate to recalibration of a sensor device for performance capture, by detecting a miscalibration problem with sensor device and assessment of the problem. A recalibration system includes sensor devices initially calibrated at a recording site. A recording site change occurs and afterwards, a failure to match virtual rays projected from one sensor device with virtual rays projected from the active marker is detected. In response to determining the failure, the active marker is signaled to emit a unique emission of electromagnetic radiation. The failure of the rays to match is assessed based on whether sensor devices capture the unique emission of electromagnetic radiation. Three-dimensional (3-D) coordinates of an active marker is reconstructed from marker data of the calibrated sensor devices.
    Type: Application
    Filed: March 10, 2022
    Publication date: June 23, 2022
    Applicant: Unity Technologies SF
    Inventors: Dejan Momcilovic, Jake Botting
  • Patent number: 11367210
    Abstract: Disclosed herein is a system to smoothly change the focus of a camera between multiple targets. The system can obtain an indication of a target, an indication of a manner of focus transition between a first target and a second target, and camera settings. The system can determine a point associated with the second target, where the point has a property that focusing the camera on the point places the second target in focus, and the point is closer to the current focus point of the camera than a substantial portion of other points having the property. The system can obtain a nonlinear function indicating a second manner of focus transition between the first target and the second target. The system can change the focus of the camera between the first target and the second target by changing the focus of the camera from the current focus point to the determined point based on the nonlinear function.
    Type: Grant
    Filed: November 12, 2021
    Date of Patent: June 21, 2022
    Assignee: Unity Technologies SF
    Inventors: Eric S. Hayes, Robert S. Hurlburt, Corey B. Frew
  • Patent number: 11366823
    Abstract: Methods and systems for transforming and delivering a digital asset are disclosed. A request is received from an application client incorporated into a memory on one of the one or more user devices and being executed by the one or more processors. The request includes a request for the digital asset and specifies a data format for the digital asset. Source data associated with the requested digital asset is located. The source data describes the digital asset. The source data is transformed in substantially real-time. The transforming includes modifying the source data into a data format consistent with the data format specified in the request. The transformed data is sent to the user device for use in the application client.
    Type: Grant
    Filed: March 13, 2020
    Date of Patent: June 21, 2022
    Assignee: Unity Technologies SF
    Inventors: Stephen Joseph Palmer, Matt Van Gorder
  • Publication number: 20220188127
    Abstract: An aspect provides a computer-implemented method for constructing evaluation logic associated with an animation software package. The method comprises receiving at least one software module, the at least one software module including at least one evaluator; writing the at least one software module to at least one executable code object; accepting a signal from a user input device to enable user control over use of the one or more functions; and converting variable length data types to be input into the one or more modules into fixed-length data types in advance of providing the data types as input arguments into the one or more modules.
    Type: Application
    Filed: March 8, 2022
    Publication date: June 16, 2022
    Applicant: Unity Technologies SF
    Inventors: Niall J. Lenihan, Richard Chi Lei, Sander van der Steen
  • Patent number: 11361494
    Abstract: A programmatic arbitrary distribution of items in a modeling system may be provided. To perform the distribution, a surface may be received, and a point count of application points associated with locations on the surface may be determined. A density map may be applied over the surface to assign a density to portions of the surface for the point count. Application points are then assigned to locations on the surface according to the density map and a scattering function of the point count, where the scattering function is based on one or more repulsion forces between neighboring points. The one or more repulsion forces are treated as pushing each of the neighboring point apart. Thereafter, the surface may be provided having the application points scattered across the surface based on the one or more repulsion forces.
    Type: Grant
    Filed: December 18, 2020
    Date of Patent: June 14, 2022
    Assignee: UNITY TECHNOLOGIES SF
    Inventor: Philip Hunter
  • Patent number: 11361477
    Abstract: An imagery processing system that combines MIP level filtering with spatial filtering when rendering images. Filtering can be performed in an order that optimizes memory accesses during the rendering process.
    Type: Grant
    Filed: January 29, 2021
    Date of Patent: June 14, 2022
    Assignee: Unity Technologies SF
    Inventors: Kimball D. Thurston, III, Luca Fascione, Sébastien Nicolas Speierer
  • Patent number: 11354774
    Abstract: In an image processing system, a scan of an actor is converted to a high-resolution two-dimensional map, which is converted to low-resolution map and to a facial rig model. Manipulations of the facial rig create a modified facial rig. A new low-resolution two-dimensional map can be obtained of the modified facial rig and a neural network can be used to generate a new high-resolution two-dimensional map that can be used to generate a mesh that is a mesh of the scan, modified by the manipulations of the facial rig.
    Type: Grant
    Filed: March 10, 2021
    Date of Patent: June 7, 2022
    Assignee: Unity Technologies SF
    Inventor: Byung Kuk Choi
  • Patent number: 11354878
    Abstract: A simulator computes surfaces corresponding to objects in a simulation by computing covariance matrices for particles that use a square root of a diagonal matrix. The simulator might operate by receiving positions and sizes for each particle of a plurality of particles comprising a first object, identifying a subset of the plurality of particles whose positions are proximate to a first surface of the first object, deforming particles of the subset of the plurality of particles by generating a covariance matrix for each particle of the plurality of particles, using a square root of a diagonal matrix, wherein the diagonal matrix is a diagonal matrix of neighboring particles for each particle of the plurality of particles, and computing the first surface of the first object based on the deformed particles.
    Type: Grant
    Filed: February 24, 2021
    Date of Patent: June 7, 2022
    Assignee: Unity Technologies SF
    Inventors: Alexey Stomakhin, Daniel Martin Elliott Jones