Patents Assigned to UNITY TECHNOLOGIES SF
  • Patent number: 11503224
    Abstract: The processor obtains a third pixel value and a second pixel value of the display. The processor determines a desired pixel value range that exceeds the second pixel value of the display. The processor obtains a threshold between the third pixel value of the display and the second pixel value of the display. The processor obtains a function mapping the desired pixel value range to a range between the threshold and the second pixel value. The processor applies the first function to an input image prior to displaying the input image on the display. The display presents the image. Upon recording the presented image, the processor determines a region within the recorded image having a pixel value between the threshold and the second pixel value. The processor increases dynamic range of the recorded image by applying an inverse of the function to the pixel value of the region.
    Type: Grant
    Filed: November 30, 2021
    Date of Patent: November 15, 2022
    Assignee: Unity Technologies SF
    Inventors: Joseph W. Marks, Luca Fascione, Kimball D. Thurston, III, Millie Maier, Kenneth Gimpelson, Dejan Momcilovic, Keith F. Miller, Peter M. Hillman, Jonathan S. Swartz
  • Patent number: 11501468
    Abstract: An image dataset is compressed by combining depth values from pixel depth arrays, wherein combining criteria are based on object data and/or depth variations of depth values in the first pixel image value array and generating a modified image dataset wherein a first pixel image value array represented in a received image dataset by the first number of image value array samples is in turn represented in the modified image dataset by a second number of compressed image value array samples with the second number being less than or equal to the first number.
    Type: Grant
    Filed: October 27, 2021
    Date of Patent: November 15, 2022
    Assignee: Unity Technologies SF
    Inventor: Peter M. Hillman
  • Patent number: 11501493
    Abstract: A computer-implemented method for procedurally simulating braided strands of fibers may include, under the control of one or more computer systems configured with executable instructions, obtaining a set of parameters of the braided strands of the fibers, the set of parameters indicating a braid spine, generating, based at least in part on the set of parameters, a set of interlacing strand spines that follow the braid spine within a tolerance according to the set of parameters, and computing a set of first geometric structures corresponding to the set of interlacing strand spines.
    Type: Grant
    Filed: November 13, 2020
    Date of Patent: November 15, 2022
    Assignee: UNITY TECHNOLOGIES SF
    Inventors: Olivier Gourmel, Paolo Selva
  • Patent number: 11501481
    Abstract: A method for generating one or more visual representations of a porous media submerged in a fluid is provided. The method can be performed using a computing device operated by a computer user or artist. The method includes defining a field comprising fluid parameter values for the fluid, the fluid parameter values comprising fluid velocity values and pore pressures. The method includes generating a plurality of particles that model a plurality of objects of the porous media, the plurality of objects being independently movable with respect to one another, determining values of motion parameters based at least in part on the field when the plurality of particles are submerged in the fluid, buoyancy and drag forces being used to determine relative motion of the plurality of particles and the fluid, and generating the one or more visual representations of the plurality of objects submerged in the fluid based on the values of the motion parameters.
    Type: Grant
    Filed: February 24, 2021
    Date of Patent: November 15, 2022
    Assignee: Unity Technologies SF
    Inventors: Alexey M Stomakhin, Joel Wretborn, Gilles Daviet
  • Patent number: 11488348
    Abstract: Methods and systems are presented for generating a virtual scene rendering usable in a captured scene based on a camera position of a camera in a stage environment, a mapping of a plurality of subregions of a virtual scene display in the stage environment to corresponding positions in the stage environment, and details of a virtual scene element. The details might include a subregion of the plurality of subregions for the virtual scene element where on the virtual scene display the given virtual scene element would, at least in part, appear, and stage subregion depth values. A blur factor for a corresponding subregion might be determined based at least in part on the stage subregion depth value and the virtual subregion depth value. Rendering the virtual scene might take into account the blur factor for the given virtual scene element.
    Type: Grant
    Filed: December 9, 2021
    Date of Patent: November 1, 2022
    Assignee: Unity Technologies SF
    Inventors: Kimball D. Thurston, III, Joseph W. Marks, Luca Fascione, Millicent Maier, Kenneth Gimpelson, Dejan Momcilovic, Keith F. Miller, Peter M. Hillman
  • Patent number: 11490034
    Abstract: The disclosed system and method can increase resolution of a display in postprocessing. The processor can obtain multiple images presented on a display, where the display is configured to present the multiple images at a first frame rate higher than a frame rate needed to form a perception of motion. The processor can obtain a mask corresponding to one or more images among the multiple images, where the mask indicates a portion of the one or more images among the multiple images to include in an output image. The processor can increase resolution of the display in proportion to the number of multiple images presented to the display by combining, based on the mask, the one or more images among the multiple images to obtain the output image.
    Type: Grant
    Filed: November 30, 2021
    Date of Patent: November 1, 2022
    Assignee: Unity Technologies SF
    Inventors: Joseph W. Marks, Luca Fascione, Kimball D. Thurston, III, Millie Maier, Kenneth Gimpelson, Dejan Momcilovic, Keith F. Miller, Peter M. Hillman, Jonathan S. Swartz, Carter Bart Sullivan
  • Patent number: 11487408
    Abstract: A computer-implemented method for managing associations between production elements and production approaches includes displaying, within a breakdown panel, a representation of at least one scene obtained from a script, the representation including a plurality of production elements; displaying, within an approaches panel, a representation of at least some of the plurality of production elements displayed within the breakdown panel, and associated respective user selection indicators; and displaying, within the approaches panel, a representation of at least one production approach. The method further includes receiving a user selection of at least one production element displayed within the approaches panel; receiving a user selection of the at least one production approach. The selected at least one production element is associated with the selected at least one production approach.
    Type: Grant
    Filed: December 7, 2021
    Date of Patent: November 1, 2022
    Assignee: Unity Technologies SF
    Inventors: Joseph Bruce Letteri, Geo H. Snelling, Matt J. Penman, Rebs Senga Guarina
  • Publication number: 20220335674
    Abstract: An animation system is provided for generating an animation control rig for character development, configured to manipulate a skeleton of an animated character. Hierarchical representation of puppets includes groups of functions related in a hierarchy according to character specialization for creating the animated rig are derived using base functions of a core component node. The hierarchical nodes may include an archetype node, at least one appendage node, and at least one feature node. In some implementations, portions of a hierarchical node, including the functions from the core component node, may be shared to generate different animation rigs for a variety of characters. In some implementations, portions of a hierarchical node, including the component node functions, may be reused to build similar appendages of a same animation rig.
    Type: Application
    Filed: June 30, 2022
    Publication date: October 20, 2022
    Applicant: UNITY TECHNOLOGIES SF
    Inventors: Thomas Stevenson, Edward Sun
  • Patent number: 11475621
    Abstract: A computer-implemented method simulates an atmospheric phenomenon within a simulation volume. At each time step of a plurality of time steps, the method automatically determines a temperature distribution of the atmospheric phenomenon based on an assumption of fixed volume, and then automatically determines a velocity field of the atmospheric phenomenon, based on an assumption of adiabatic expansion.
    Type: Grant
    Filed: March 30, 2021
    Date of Patent: October 18, 2022
    Assignee: Unity Technologies SF
    Inventors: Ken Museth, Alexey Stomakhin
  • Patent number: 11468546
    Abstract: A processor performing postprocessing obtains an input image containing both bright and dark regions. The processor obtains a threshold between a first pixel value of the virtual production display and a second pixel value of the virtual production display. The processor modifies the region according to predetermined steps producing a pattern unlikely to occur within the input image, where the pattern corresponds to a difference between the original pixel value and the threshold. The processor can replace the region of the input image with the pattern to obtain a modified image. The virtual production display can present the modified image. A processor performing postprocessing detects the pattern within the modified image displayed on the virtual production display. The processor calculates the original pixel value of the region by reversing the predetermined steps. The processor replaces the pattern in the modified image with the original pixel value.
    Type: Grant
    Filed: November 30, 2021
    Date of Patent: October 11, 2022
    Assignee: Unity Technologies SF
    Inventors: Joseph W. Marks, Luca Fascione, Kimball D. Thurston, III, Millie Maier, Kenneth Gimpelson, Dejan Momcilovic, Keith F. Miller, Peter M. Hillman, Jonathan S. Swartz
  • Patent number: 11461965
    Abstract: A representation of a surface in a three-dimensional space is obtained. A first input representing a starting point and a second input representing a next point are obtained. A representation of a surface-aware spline comprising vertices is generated, with the representation of the surface-aware spline including a starting vertex corresponding to the starting point and a next vertex corresponding to the next point. First and second projection points corresponding to projections of a first vertex and a second vertex onto the surface are determined. New points corresponding to equal distance points for the first and second vertices aligned with the first and second projection points are determined, and a rigid transformation is determined from the new points. The representation of the surface-aware spline is adjusted based on a transformation of the new points using the rigid transformation.
    Type: Grant
    Filed: November 13, 2020
    Date of Patent: October 4, 2022
    Assignee: UNITY TECHNOLOGIES SF
    Inventors: Olivier Gourmel, Paolo Selva
  • Patent number: 11461968
    Abstract: A computer-implemented method and system for modeling an outer surface, such as skin. The method includes, under the control of one or more computer systems configured with executable instructions, defining a plurality of microstructures such as microstructures to be displayed in microstructure locations on a geometric model of a character or inanimate object, and generating a volumetric mesh including the plurality of microstructures. The volumetric mesh is configured to be applied to the geometric model as an outer surface (e.g., skin) covering the geometric model.
    Type: Grant
    Filed: September 28, 2020
    Date of Patent: October 4, 2022
    Assignee: Unity Technologies SF
    Inventors: Emiliano Padovani, Artur Vill
  • Patent number: 11457127
    Abstract: Implementations provide a wearable article for a performance capture system. In some implementations, a wearable article includes one or more regions, where the one or more regions are configured to be worn on at least a portion of a body of a user, and where at least one of the one or more regions are configured to hold performance capture equipment in predetermined positions. In some implementations, the wearable article also includes a plurality of mounting mechanisms coupled to the one or more regions for mounting reference markers to be used for position determination. In some implementations, the wearable article also includes a plurality of fastening mechanisms coupled to the one or more regions for fastening devices and accessories for controlling the reference markers.
    Type: Grant
    Filed: November 24, 2021
    Date of Patent: September 27, 2022
    Assignee: UNITY TECHNOLOGIES SF
    Inventors: Dejan Momcilovic, Jake Botting
  • Patent number: 11455444
    Abstract: A method for generating visual representations of interactions between two different materials is provided. The method can be performed using a computing device operated by a computer user or artist. The method includes modeling a primary material as a plurality of first particles and modeling a layer portion of a secondary material as a fluid volume. The secondary material can include a layer portion positioned between the plurality of first particles and an outer portion. At least one boundary condition might be assigned to a boundary positioned between the layer portion and the outer portion, the at least one boundary condition includes at least one pressure value. Values of motion parameters might be determined by applying the at least one boundary condition at the boundary and generating one or more visual representations of the primary material interacting with the secondary material based on the values of the motion parameters.
    Type: Grant
    Filed: November 10, 2021
    Date of Patent: September 27, 2022
    Assignee: Unity Technologies SF
    Inventors: Alexey Stomakhin, Sven Joel Wretborn, Gilles Daviet, Daniel Martin Elliott Jones
  • Patent number: 11451708
    Abstract: A processor calibrates the camera by presenting an input image on the display to obtain a presented image. The camera, arbitrarily positioned relative to the display, records the presented image. The processor obtains the input image via a channel different from the display. The processor obtains an indication of a display region associated with the display. The processor determines an input image region corresponding to the display region, and a recorded image region corresponding to the display region. The processor obtains a first pixel value associated with the input image region and a second pixel value associated with the recorded image region. The processor determines a mapping between the first pixel value and the second pixel value, where applying the mapping to the second pixel value substantially produces the first pixel value. The processor stores an identifier associated with the recorded image region and the mapping.
    Type: Grant
    Filed: November 30, 2021
    Date of Patent: September 20, 2022
    Assignee: Unity Technologies SF
    Inventors: Joseph W. Marks, Luca Fascione, Kimball D. Thurston, III, Millie Maier, Kenneth Gimpelson, Dejan Momcilovic, Keith F. Miller, Peter M. Hillman, Jonathan S. Swartz
  • Patent number: 11451709
    Abstract: A processor performing postprocessing obtains an input image containing both bright and dark regions. The processor obtains a threshold between a first pixel value of the virtual production display and a second pixel value of the virtual production display. The processor modifies the region according to predetermined steps producing a pattern unlikely to occur within the input image, where the pattern corresponds to a difference between the original pixel value and the threshold. The processor can replace the region of the input image with the pattern to obtain a modified image. The virtual production display can present the modified image. A processor performing postprocessing detects the pattern within the modified image displayed on the virtual production display. The processor calculates the original pixel value of the region by reversing the predetermined steps. The processor replaces the pattern in the modified image with the original pixel value.
    Type: Grant
    Filed: November 30, 2021
    Date of Patent: September 20, 2022
    Assignee: Unity Technologies SF
    Inventors: Joseph W. Marks, Luca Fascione, Kimball D. Thurston, III, Millie Maier, Kenneth Gimpelson, Dejan Momcilovic, Keith F. Miller, Peter M. Hillman, Jonathan S. Swartz
  • Patent number: 11450054
    Abstract: A character rig may be representable as a data structure specifying a plurality of articulated character parts, an element tree specifying relations between character parts, and a set of constraints on the character parts. After receiving rotoscoping movement input data corresponding to attempted alignments of movements of at least some of the character parts with elements moving in a captured live action scene, a rotoscoping constraints may be received. The rotoscoping constraint may include at least a first constraint on the character rig other than a second constraint specified by the data structure of the character rig, Thereafter, rig movement inputs for a second set of character parts distinct from the first set of character parts may be accepted and the character rig may be moved according to the rig movement inputs while constrained by the rotoscoping constraints.
    Type: Grant
    Filed: April 23, 2021
    Date of Patent: September 20, 2022
    Assignee: UNITY TECHNOLOGIES SF
    Inventors: Byung Kuk Choi, Albrecht Steinmetz
  • Patent number: 11443473
    Abstract: An animation system wherein a machine learning model is adopted to generate animated facial actions based on parameters obtained from a live actor. Specifically, the anatomical structure such as a facial muscle topology and a skull surface that are specific to the live actor may be used. A skull surface that is specific to a live actor based on facial scans of the live actor and generic tissue depth data. For example, the facial scans of the live actor may provide a skin surface topology of the live actor, based on which the skull surface underneath the skin surface can be derived by “offsetting” the skin surface with corresponding soft tissue depth at different sampled points on the skin surface.
    Type: Grant
    Filed: June 14, 2021
    Date of Patent: September 13, 2022
    Assignee: Unity Technologies SF
    Inventor: Byung Kuk Choi
  • Patent number: 11443676
    Abstract: The disclosed system modifies luminance of a display associated with a selective screen. The display provides a camera with an image having resolution higher than the resolution of the display by presenting multiple images while the selective screen enables light from different portions of the multiple images to reach the camera. The resulting luminance of the recorded image is lower than a combination of luminance values of the multiple images. The processor obtains a criterion indicating a property of the input image where image detail is unnecessary. The processor detects a region of the input image satisfying the criterion, and determines a region of the selective screen corresponding to the region of the input image. The processor increases the luminance of the display by disabling the region of the selective screen corresponding to the region of the input image.
    Type: Grant
    Filed: November 30, 2021
    Date of Patent: September 13, 2022
    Assignee: Unity Technologies SF
    Inventors: Joseph W. Marks, Luca Fascione, Kimball D. Thurston, III, Millie Maier, Kenneth Gimpelson, Dejan Momcilovic, Keith F. Miller, Peter M. Hillman, Jonathan S. Swartz, Carter Bart Sullivan
  • Patent number: 11443450
    Abstract: Embodiments provide multi-angle screen coverage analysis. In some embodiments, a system obtains at least one image, where the at least one image is a computer graphics generated image, and where the at least one image comprises at least one target object. The system determines screen coverage information for the at least one target object, where the screen coverage information is based on a portion of a screen that is covered by the at least one target object. The system determines depth information for the at least one target object. The system determines an asset detail level for the at least one target object based on the screen coverage information and the depth information, where the asset detail level is adjustable based on the screen coverage information. The system then stores the asset detail level in a database.
    Type: Grant
    Filed: October 13, 2021
    Date of Patent: September 13, 2022
    Assignee: UNITY TECHNOLOGIES SF
    Inventor: Kenneth Gimpelson