Abstract: A system and method are provided for obtaining a 3D cue path and timing. In one example aspect, this path and timing may be manipulated in software. In another example aspect, one or more conditions may be specified which pertain to the path, timing, state of the path's environment, or state of one or more objects or actors in the path's environment. In another example aspect, these conditions may be accompanied by specifications for one or more actions to be taken if one or more of the conditions are or are not satisfied. In another example aspect, a person or object may be monitored as they follow the path, and prescribed actions may be taken if the specified conditions are or are not found to be satisfied.

Abstract: Systems and methods are provided for calibrating equipment, such as a lighting fixture. A kinematic model of the lighting fixture is obtained. Test points, which include a pair of a corresponding control signal and an output are collected. These can be collected using a tracking system. The test points are then used to update the kinematic model of the lighting fixture. The process of updating the kinematic model can include the use of a Kalman filter. The calibration is then verified and may be re-calibrated. These methods can also be used to calibrate other equipment, for example, lasers, light projectors showing media content, audio speaker, microphones, cameras, and projectile equipment.

Abstract: Systems and methods are provided for generating calibration information for a media projector. The method includes tracking at least position of a tracking apparatus that can be positioned on a surface. The media projector shines a test spot on the surface, and the test spot corresponds to a known pixel coordinate of the media projector. The system includes a computing device in communication with at least two cameras, wherein each of the cameras are able to capture images of one or more light sources attached to an object. The computing device determines the object's position by comparing images of the light sources and generates an output comprising the real-world position of the object. This real-world position is mapped to the known pixel coordinate of the media projector.

Abstract: Systems and methods are provided for associating position information and sound. The method includes obtaining position information of an object at a given time; obtaining position information of a camera at the given time; determining a relative position of the object relative to the camera's position; and associating sound information with the relative position of the object. In another aspect, the position and orientation of a microphone are also tracked to calibrate the sound produced by an object or person, and the calibrated sound is associated with the relative position of the object, that is relative to the camera.

Abstract: Systems and methods are provided for generating calibration information for a media projector. The method includes tracking at least position of a tracking apparatus that can be positioned on a surface. The media projector shines a test spot on the surface, and the test spot corresponds to a known pixel coordinate of the media projector. The system includes a computing device in communication with at least two cameras, wherein each of the cameras are able to capture images of one or more light sources attached to an object. The computing device determines the object's position by comparing images of the light sources and generates an output comprising the real-world position of the object. This real-world position is mapped to the known pixel coordinate of the media projector.

Abstract: Systems and methods are provided for tracking at least position and angular orientation. The system comprises a computing device in communication with at least two cameras, wherein each of the cameras are able to capture images of one or more light sources attached to an object. A receiver is in communication with the computing device, wherein the receiver is able to receive at least angular orientation data associated with the object. The computing device determines the object's position by comparing images of the light sources and generates an output comprising the position and angular orientation of the object.

Abstract: Systems and methods are provided for using tracking data to control the functions of an automated fixture. Examples of automated fixtures include light fixtures and camera fixtures. A method includes obtaining a first position of a tracking unit. The tracking unit includes an inertial measurement unit and a visual indicator configured to be tracked by a camera. A first distance is computed between the automated fixture and the first position and it is used to set a function of the automated fixture to a first setting. A second position of the tracking unit is obtained. A second distance between the automated fixture and the second position is computed, and the second distance is used to set the function of the automated fixture to a second setting.

Abstract: A system and method are provided for controlling a plurality of vehicles to affect positioning of a common payload. The system comprises of multiple vehicles having positioners to change the location of the common payload, where the group of vehicles form a swarm that is controlled by a driver or pilot station. Each vehicle is autonomously stabilized and guided through a swarm electronics unit, which further includes sensor, communication, and processing hardware. At the driver or pilot station, a system or a person remotely enters payload destinations, which is processed and communicated to each vehicle. The method for controlling a multi-vehicle system includes inputting the desired location of the payload and determining a series of intermediary payload waypoints. Next, these payload waypoints are used by the swarm waypoint controller to generate individual waypoints for each vehicle. A controller for each vehicle moves the vehicle to these individual waypoints.

Abstract: A system and method are provided for controlling a plurality of vehicles to affect positioning of a common payload. The system comprises of multiple vehicles having positioners to change the location of the common payload, where the group of vehicles form a swarm that is controlled by a driver or pilot station. Each vehicle is autonomously stabilized and guided through a swarm electronics unit, which further includes sensor, communication, and processing hardware. At the driver or pilot station, a system or a person remotely enters payload destinations, which is processed and communicated to each vehicle. The method for controlling a multi-vehicle system includes inputting the desired location of the payload and determining a series of intermediary payload waypoints. Next, these payload waypoints are used by the swarm waypoint controller to generate individual waypoints for each vehicle. A controller for each vehicle moves the vehicle to these individual waypoints.

Abstract: A system and method are provided for obtaining a 3D cue path and timing. In one example aspect, this path and timing may be manipulated in software. In another example aspect, one or more conditions may be specified which pertain to the path, timing, state of the path's environment, or state of one or more objects or actors in the path's environment. In another example aspect, these conditions may be accompanied by specifications for one or more actions to be taken if one or more of the conditions are or are not satisfied. In another example aspect, a person or object may be monitored as they follow the path, and prescribed actions may be taken if the specified conditions are or are not found to be satisfied.

Abstract: A configurable real-time environment tracking and command module (RTM) is provided to coordinate one or more than one devices or objects in a physical environment. A virtual environment is created to correlate with various objects and attributes within the physical environment. The RTM is able to receive data about attributes of physical objects and accordingly update the attributes of correlated virtual objects in the virtual environment. The RTM is also able to provide data extracted from the virtual environment to one or more than devices, such as robotic cameras, in real-time. An interface to the RTM allows multiple devices to interact with the RTM, thereby coordinating the devices.

Abstract: Systems and methods are provided for calibrating equipment, such as a lighting fixture. A kinematic model of the lighting fixture is obtained. Test points, which include a pair of a corresponding control signal and an output are collected. These can be collected using a tracking system. The test points are then used to update the kinematic model of the lighting fixture. The process of updating the kinematic model can include the use of a Kalman filter. The calibration is then verified and may be re-calibrated. These methods can also be used to calibrate other equipment, for example, lasers, light projectors showing media content, audio speaker, microphones, cameras, and projectile equipment.

Abstract: Systems and methods are provided for tracking at least position and angular orientation. The system comprises a computing device in communication with at least two cameras, wherein each of the cameras are able to capture images of one or more light sources attached to an object. A receiver is in communication with the computing device, wherein the receiver is able to receive at least angular orientation data associated with the object. The computing device determines the object's position by comparing images of the light sources and generates an output comprising the position and angular orientation of the object.

Abstract: Systems and methods are provided for tracking at least position and angular orientation. The system comprises a computing device in communication with at least two cameras, wherein each of the cameras are able to capture images of one or more light sources attached to an object. A receiver is in communication with the computing device, wherein the receiver is able to receive at least angular orientation data associated with the object. The computing device determines the object's position by comparing images of the light sources and generates an output comprising the position and angular orientation of the object.

Abstract: A system and method are provided for controlling a plurality of aircraft to lift a common payload. The system comprises of multiple aircraft tethered to a common payload, where the group of aircraft form a swarm that is controlled by a pilot station. Each aircraft is autonomously stabilized and guided through a swarm avionics unit, which further includes sensor, communication, and processing hardware. At the pilot station, a pilot remotely enters payload destinations, which is processed and communicated to each aircraft. The method for controlling a multi-aircraft lifting system includes of inputting the desired location of the payload, and determining a series of intermediary payload waypoints. Next, these payload waypoints are used by the swarm waypoint controller to generate individual waypoints for each aircraft. A flight controller for each aircraft moves the aircraft to these individual waypoints.

Abstract: A configurable real-time environment tracking and command module (RTM) is provided to coordinate one or more than one devices or objects in a physical environment. A virtual environment is created to correlate with various objects and attributes within the physical environment. The RTM is able to receive data about attributes of physical objects and accordingly update the attributes of correlated virtual objects in the virtual environment. The RTM is also able to provide data extracted from the virtual environment to one or more than devices, such as robotic cameras, in real-time. An interface to the RTM allows multiple devices to interact with the RTM, thereby coordinating the devices.

Abstract: A configurable real-time environment tracking and command module (RTM) is provided to coordinate one or more than one devices or objects in a physical environment. A virtual environment is created to correlate with various objects and attributes within the physical environment. The RTM is able to receive data about attributes of physical objects and accordingly update the attributes of correlated virtual objects in the virtual environment. The RTM is also able to provide data extracted from the virtual environment to one or more than devices, such as robotic cameras, in real-time. An interface to the RTM allows multiple devices to interact with the RTM, thereby coordinating the devices.

Abstract: A system and method are provided for controlling a plurality of aircraft to lift a common payload. The system comprises of multiple aircraft tethered to a common payload, where the group of aircraft form a swarm that is controlled by a pilot station. Each aircraft is autonomously stabilized and guided through a swarm avionics unit, which further includes sensor, communication, and processing hardware. At the pilot station, a pilot remotely enters payload destinations, which is processed and communicated to each aircraft. The method for controlling a multi-aircraft lifting system includes of inputting the desired location of the payload, and determining a series of intermediary payload waypoints. Next, these payload waypoints are used by the swarm waypoint controller to generate individual waypoints for each aircraft. A flight controller for each aircraft moves the aircraft to these individual waypoints.

Abstract: Systems and methods are provided for associating position information and sound. The method includes obtaining position information of an object at a given time; obtaining position information of a camera at the given time; determining a relative position of the object relative to the camera's position; and associating sound information with the relative position of the object. In another aspect, the position and orientation of a microphone are also tracked to calibrate the sound produced by an object or person, and the calibrated sound is associated with the relative position of the object, that is relative to the camera.

Abstract: A system and method are provided for controlling a plurality of aircraft to lift a common payload. The system comprises of multiple aircraft tethered to a common payload, where the group of said aircraft form a swarm that is controlled by a pilot station. Each said aircraft is autonomously stabilized and guided through a swarm avionics unit, which further comprises of sensor, communication, and processing hardware. At the said pilot station, a pilot remotely enters payload destinations, which is processed and communicated to each said aircraft. The method for controlling a multi-aircraft lifting system comprises of first inputting the desired location of the payload, and then determining a series of intermediary payload waypoints. Next, these payload waypoints are used by the swarm waypoint controller to generate individual waypoints for each aircraft; a flight controller for each aircraft moves the aircraft to these individual waypoints.