Patents by Inventor Jake Botting

Jake Botting has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230236319
    Abstract: An active marker relay system is provided to operate responsive active markers coupled to an object in a live action scene for performance capture, via a trigger unit that relays energy pulse information to responsive active markers. Using use simple sensors, the responsive active markers sense control energy pulses projected from the trigger unit. In return, the responsive active markers produce energy pulses that emulate at least one characteristic of the control energy pulses, such as a particular pulse rate or wavelength of energy. The reactivity of the responsive active markers to control energy pulses enables simple control of the responsive active markers through the trigger unit.
    Type: Application
    Filed: January 25, 2023
    Publication date: July 27, 2023
    Applicant: Unity Technologies SF
    Inventors: Dejan Momcilovic, Jake Botting
  • Patent number: 11636621
    Abstract: Embodiments facilitate the calibration of cameras in a live action scene using fixed cameras and drones. In some embodiments, a method configures a plurality of reference cameras to observe at least three known reference points located in the live action scene and to observe one or more reference points associated with one or more moving cameras having unconstrained motion. The method further configures the one or more moving cameras to observe one or more moving objects in the live action scene. The method further receives reference point data in association with one or more reference cameras of the plurality of reference cameras, where the reference point data is based on the at least three known reference points and the one or more reference points associated with the one or more moving cameras.
    Type: Grant
    Filed: December 11, 2020
    Date of Patent: April 25, 2023
    Assignee: UNITY TECHNOLOGIES SF
    Inventors: Dejan Momcilovic, Jake Botting
  • Patent number: 11600022
    Abstract: Embodiments facilitate the calibration of cameras in a live action scene using drones. In some embodiments, a method configures a plurality of reference cameras to observe at least one portion of the live action scene. The method further configures one or more moving cameras having unconstrained motion to observe one or more moving objects in the live action scene and to observe at least three known reference points associated with the plurality of reference cameras. The method further receives reference point data in association with the one or more moving cameras, where the reference point data is based on the at least three known reference points. The method further computes a location and an orientation of each moving camera of the one or more moving cameras based on one or more of the reference point data and one or more locations of one or more reference cameras of the plurality of reference cameras.
    Type: Grant
    Filed: December 11, 2020
    Date of Patent: March 7, 2023
    Assignee: UNITY TECHNOLOGIES SF
    Inventors: Dejan Momcilovic, Jake Botting
  • Patent number: 11537162
    Abstract: Embodiments provide a wearable article for a performance capture system. In some embodiments, a wearable article includes one or more regions, where the one or more regions are configured to be worn on at least a portion of a body of a user, where the one or more regions have a first pliability and a second pliability, where the first pliability and the second pliability are different pliabilities, and where at least one of the one or more regions are configured to hold devices in predetermined positions while maintaining shape and respective pliability. In some embodiments, the wearable article also includes a plurality of mounting mechanisms coupled to the one or more regions for mounting one or more reference markers to be used for position determination.
    Type: Grant
    Filed: April 30, 2021
    Date of Patent: December 27, 2022
    Assignee: UNITY TECHNOLOGIES SF
    Inventors: Dejan Momcilovic, Jake Botting
  • Patent number: 11508081
    Abstract: A sealed active marker apparatus of a performance capture system is described to provide protective housing for active marker light components coupled to a strand and attached via a receptacle, to an object, such as via a wearable article, in a live action scene. The receptacle includes a protrusion portion that permits at least one particular wavelength range of light emitted from the enclosed active marker light component, to diffuse in a manner that enables easy detection by a sensor device. A base portion interlocks with a bottom plate of the receptacle to secure the strand within one or more channels. A sealant material coating portions of the apparatus promotes an insulating environment for the active marker light component.
    Type: Grant
    Filed: November 30, 2020
    Date of Patent: November 22, 2022
    Assignee: UNITY TECHNOLOGIES SF
    Inventors: Dejan Momcilovic, Jake Botting
  • Patent number: 11457127
    Abstract: Implementations provide a wearable article for a performance capture system. In some implementations, a wearable article includes one or more regions, where the one or more regions are configured to be worn on at least a portion of a body of a user, and where at least one of the one or more regions are configured to hold performance capture equipment in predetermined positions. In some implementations, the wearable article also includes a plurality of mounting mechanisms coupled to the one or more regions for mounting reference markers to be used for position determination. In some implementations, the wearable article also includes a plurality of fastening mechanisms coupled to the one or more regions for fastening devices and accessories for controlling the reference markers.
    Type: Grant
    Filed: November 24, 2021
    Date of Patent: September 27, 2022
    Assignee: UNITY TECHNOLOGIES SF
    Inventors: Dejan Momcilovic, Jake Botting
  • Patent number: 11403883
    Abstract: The present description relates to light patterns used in a live action scene of a visual production to encode information associated with objects in the scene, such as movement and position of the objects. A data capture system is enabled to differentiate between various groups of active markers attached to the objects in the scene. The groups of active markers emit particular wavelengths in strobing patterns predefined for the various groups. In some implementations, the groups are instructed to emit its assigned signature light pattern through a signal controller transmitting an initial key signature predefined for the group, followed by pattern signals to a control unit. The data representing the pattern is captured in illuminated and blank frames. Frames showing the light pattern are analyzed to extract information about the groups of active markers, such as distinguishing the groups and identifying the objects to which they are attached.
    Type: Grant
    Filed: January 29, 2021
    Date of Patent: August 2, 2022
    Assignee: UNITY TECHNOLOGIES SF
    Inventors: Dejan Momcilovic, Jake Botting
  • Patent number: 11403775
    Abstract: An active marker apparatus is provided for securely affixing active markers to a wearable article of an object in a performance capture system. The active marker light components coupled to a strand, are inserted into a receptacle to position the active marker light components onto the wearable article. A gap is provided in a chamber between the active marker light component and an interior surface of a protrusion portion of the receptacle. At least a section of the protrusion portion permits light emitted from the active marker light component into the chamber, to diffuse in a manner that allows the light to be easily detected by a camera in the live action scene. Each active marker light component is locked into place in a respective receptacle by one or more channels that receive the strand. A cap fitting may further assist in securing the receptacle to the wearable article and optionally aid in visual detection of the receptacle.
    Type: Grant
    Filed: November 30, 2020
    Date of Patent: August 2, 2022
    Assignee: UNITY TECHNOLOGIES SF
    Inventors: Dejan Momcilovic, Jake Botting
  • Patent number: 11380136
    Abstract: The present description relates to light patterns used in a live action scene of a visual production to encode information associated with objects in the scene, such as movement and position of the objects. A data capture system includes active markers that emit light of a particular wavelength in predefined strobing patterns. In some implementations, the active markers are instructed to emit an assigned signature pattern of light through a signal controller sending signals to a control unit. Various components are synchronized such that pulsing of light corresponds to time slices and particular frames captured by the performance capture system. The data representing the pattern is embedded in illuminated and blank frames. Frames showing the light pattern are analyzed to extract information about the active markers, such as identification of the active markers and objects to which they are attached.
    Type: Grant
    Filed: December 2, 2021
    Date of Patent: July 5, 2022
    Assignee: UNITY TECHNOLOGIES SF
    Inventors: Dejan Momcilovic, Jake Botting
  • Publication number: 20220198713
    Abstract: The present description relates relate to recalibration of a sensor device for performance capture, by detecting a miscalibration problem with sensor device and assessment of the problem. A recalibration system includes sensor devices initially calibrated at a recording site. A recording site change occurs and afterwards, a failure to match virtual rays projected from one sensor device with virtual rays projected from the active marker is detected. In response to determining the failure, the active marker is signaled to emit a unique emission of electromagnetic radiation. The failure of the rays to match is assessed based on whether sensor devices capture the unique emission of electromagnetic radiation. Three-dimensional (3-D) coordinates of an active marker is reconstructed from marker data of the calibrated sensor devices.
    Type: Application
    Filed: March 10, 2022
    Publication date: June 23, 2022
    Applicant: Unity Technologies SF
    Inventors: Dejan Momcilovic, Jake Botting
  • Patent number: 11308644
    Abstract: The present description relates relate to recalibration of a sensor device for performance capture, by detecting a miscalibration problem with sensor device and assessment of the problem. A recalibration system includes sensor devices initially calibrated at a recording site. A recording site change occurs and afterwards, a failure to match virtual rays projected from one sensor device with virtual rays projected from the active marker is detected. In response to determining the failure, the active marker is signaled to emit a unique display of light. The failure of the rays to match is assessed based on whether sensor devices capture the unique display of light. Three-dimensional (3-D) coordinates of an active marker is reconstructed from marker data of the calibrated sensor devices. A problematic sensor device is recalibrated based on the assessment, using the 3-D coordinates of the active marker from marker data of the remaining calibrated sensor devices, without stopping the recording.
    Type: Grant
    Filed: July 16, 2021
    Date of Patent: April 19, 2022
    Assignee: WETA DIGITAL LIMITED
    Inventors: Dejan Momcilovic, Jake Botting
  • Patent number: 11288496
    Abstract: The present description relates to light patterns used in a live action scene of a visual production to encode information associated with objects in the scene, such as movement and position of the objects. A data capture system includes active markers that emit light of a particular wavelength in predefined strobing patterns. In some implementations, the active markers are instructed to emit an assigned signature pattern of light through a signal controller sending signals to a control unit. Various components are synchronized such that pulsing of light corresponds to time slices and particular frames captured by the performance capture system. The data representing the pattern is embedded in illuminated and blank frames. Frames showing the light pattern are analyzed to extract information about the active markers, such as identification of the active markers and objects to which they are attached.
    Type: Grant
    Filed: May 28, 2021
    Date of Patent: March 29, 2022
    Assignee: WETA DIGITAL LIMITED
    Inventors: Dejan Momcilovic, Jake Botting
  • Publication number: 20220092301
    Abstract: The present description relates to light patterns used in a live action scene of a visual production to encode information associated with objects in the scene, such as movement and position of the objects. A data capture system includes active markers that emit light of a particular wavelength in predefined strobing patterns. In some implementations, the active markers are instructed to emit an assigned signature pattern of light through a signal controller sending signals to a control unit. Various components are synchronized such that pulsing of light corresponds to time slices and particular frames captured by the performance capture system. The data representing the pattern is embedded in illuminated and blank frames. Frames showing the light pattern are analyzed to extract information about the active markers, such as identification of the active markers and objects to which they are attached.
    Type: Application
    Filed: December 2, 2021
    Publication date: March 24, 2022
    Applicant: Weta Digital Limited
    Inventors: Dejan Momcilovic, Jake Botting
  • Patent number: 11282233
    Abstract: Embodiments facilitate the calibration of cameras in a live action scene. In some embodiments, a system receives images of the live action scene from a plurality of cameras. The system further receives reference point data generated from a performance capture system, where the reference point data is based on at least three reference points, where the at least three reference points are positioned within the live action scene, and where distances between the at least three reference points are predetermined. The system further determines a location and orientation of each camera based on the reference point data.
    Type: Grant
    Filed: February 25, 2021
    Date of Patent: March 22, 2022
    Assignee: WETA DIGITAL LIMITED
    Inventors: Dejan Momcilovic, Jake Botting
  • Publication number: 20220086308
    Abstract: Implementations provide a wearable article for a performance capture system. In some implementations, a wearable article includes one or more regions, where the one or more regions are configured to be worn on at least a portion of a body of a user, and where at least one of the one or more regions are configured to hold performance capture equipment in predetermined positions. In some implementations, the wearable article also includes a plurality of mounting mechanisms coupled to the one or more regions for mounting reference markers to be used for position determination. In some implementations, the wearable article also includes a plurality of fastening mechanisms coupled to the one or more regions for fastening devices and accessories for controlling the reference markers.
    Type: Application
    Filed: November 24, 2021
    Publication date: March 17, 2022
    Applicant: Weta Digital Limited
    Inventors: Dejan Momcilovic, Jake Botting
  • Publication number: 20220076452
    Abstract: Embodiments facilitate the calibration of cameras in a live action scene. In some embodiments, a system receives images of the live action scene from a plurality of cameras. The system further receives reference point data generated from a performance capture system, where the reference point data is based on at least three reference points, where the at least three reference points are attached to a linear form, and where distances between the at least three reference points are predetermined. The system further locates the at least three reference points in one or more images of the images. The system further computes one or more ratios of the distances between each adjacent pair of reference points of the at least three reference points in the one or more images. The system further determines a location and orientation of each camera based on the reference point data.
    Type: Application
    Filed: February 25, 2021
    Publication date: March 10, 2022
    Applicant: Weta Digital Limited
    Inventors: Dejan Momcilovic, Jake Botting
  • Publication number: 20220076450
    Abstract: Embodiments facilitate the calibration of cameras in a live action scene. In some embodiments, a system receives images of the live action scene from a plurality of cameras. The system further receives reference point data generated from a performance capture system, where the reference point data is based on at least three reference points, where the at least three reference points are positioned within the live action scene, and where distances between the at least three reference points are predetermined. The system further determines a location and orientation of each camera based on the reference point data.
    Type: Application
    Filed: February 25, 2021
    Publication date: March 10, 2022
    Applicant: Weta Digital Limited
    Inventors: Dejan Momcilovic, Jake Botting
  • Publication number: 20220076451
    Abstract: Embodiments facilitate the calibration of cameras in a live action scene. In some embodiments, a system receives images of the live action scene from a plurality of cameras. The system further receives reference point data generated from a performance capture system, where the reference point data is based on a plurality of reference points coupled to a plurality of extensions coupled to a base, where the plurality of reference points are in a non-linear arrangement, where distances between references points are predetermined. The system further computes reference point data generated from a performance capture system and based on the distances. The system further computes a location and orientation of each camera in the live action scene based on the reference point data.
    Type: Application
    Filed: February 25, 2021
    Publication date: March 10, 2022
    Applicant: Weta Digital Limited
    Inventors: Dejan Momcilovic, Jake Botting
  • Publication number: 20220067968
    Abstract: Embodiments facilitate the calibration of cameras in a live action scene using drones with multiple cameras. In some embodiments, a method configures a plurality of reference cameras to observe at least one portion of the live action scene. The method further configures at least one first camera coupled to an apparatus to observe one or more moving objects in the live action scene. The method further configures at least one second camera coupled to the at least one apparatus to observe at least three known reference points located in the live action scene. The method further receives reference point data in association with the at least one second camera, where the reference point data is based on the at least three known reference points. The method further computes a location and an orientation of the at least one first camera and the at least one second camera based on the reference point data.
    Type: Application
    Filed: December 11, 2020
    Publication date: March 3, 2022
    Applicant: Weta Digital Limited
    Inventors: Dejan Momcilovich, Jake Botting
  • Patent number: D991056
    Type: Grant
    Filed: September 28, 2020
    Date of Patent: July 4, 2023
    Assignee: UNITY TECHNOLOGIES SF
    Inventors: Dejan Momcilovich, Jake Botting