Abstract: A system which enables third person observation of an AR or VR player and their interaction with the virtual environment, including a separate live action spectator camera, a system to track that camera, and a system to integrate the live action and virtual images in real time.

Abstract: A system for combining live action and virtual images in real time that enables automatic time and position alignment between the live action and virtual images, and provides a self-contained tracking sensor that enables wireless and multi-camera operation.

Abstract: A system for combining live action and virtual images in real time into a final composite image as viewed by a user through a head mounted display, and which uses a self-contained tracking sensor to enable large groups of users to use the system simultaneously and in complex walled environments, and a color keying based algorithm to determine display of real or virtual imagery to the user.

Abstract: Disclosed herein are through-the-lens tracking systems and methods which can enable sub-pixel accurate camera tracking suitable for real-time set extensions. That is, the through-the-lens tracking can make an existing lower precision camera tracking and compositing system into a real-time VFX system capable of sub-pixel accurate real-time camera tracking. With this enhanced level of tracking accuracy the virtual cameras can be used to register and render real-time set extensions for both interior and exterior locations.

Abstract: A system for generating automatically tracking mattes that rapidly integrates live action and virtual composite images.

Abstract: Disclosed herein are through-the-lens tracking systems and methods which can enable sub-pixel accurate camera tracking suitable for real-time set extensions. That is, the through-the-lens tracking can make an existing lower precision camera tracking and compositing system into a real-time VFX system capable of sub-pixel accurate real-time camera tracking. With this enhanced level of tracking accuracy the virtual cameras can be used to register and render real-time set extensions for both interior and exterior locations.

Abstract: A system for generating automatically tracking mattes that rapidly integrates live action and virtual composite images.

Abstract: A system for generating automatically tracking mattes that rapidly integrates live action and virtual composite images.

Abstract: A system for calculating intrinsic properties and an entry pupil location of an adjustable camera lens is disclosed. The system includes a camera and a calibration target. Methods for calculating intrinsic properties and an entry pupil location of an adjustable camera lens are also disclosed.

Abstract: A system and method for removing background lighting variations from an image. The method includes capturing at least one first image including a first background and a subject wherein the at least one first image includes at least one background lighting variation, creating a virtual background model of the first background, creating a virtual background image that is substantially similar to the first background, and generating an output comprising at least one first image with at least one background lighting variation removed therefrom.

Abstract: A system for calculating intrinsic properties and an entry pupil location of an adjustable camera lens is disclosed. The system includes a camera and a calibration target. Methods for calculating intrinsic properties and an entry pupil location of an adjustable camera lens are also disclosed.

Abstract: A system and method for removing background lighting variations from an image. The method includes capturing at least one first image including a first background and a subject wherein the at least one first image includes at least one background lighting variation, creating a virtual background model of the first background, creating a virtual background image that is substantially similar to the first background, and generating an output comprising at least one first image with at least one background lighting variation removed therefrom.

Abstract: An image producing system including at least one scene camera viewing a first image within a defined space, a processor connected to the at least one scene camera, a wide area tracking sensor positioned proximate the defined space, but positioned outside a view of the scene camera, said wide area tracking sensor, coupled to the scene camera, oriented to view at least a portion of the identifying indicia, and a high precision local angular sensor, coupled to the scene camera.

Abstract: The 3D position of a subject being recorded for film, video, or digital media creation may be recorded using an inexpensive 3D distance measuring system and recorder attached to a 2D film, video, or digital camera and used to create high quality composite images. The 3D information is used to generate a virtual camera and 3D geometry representing the subject in a virtual scene using a commercial 3D graphics software package. Color keying technology is used to separate the live action subject from the studio background. The live action subject images are projected onto the 3D geometry in the virtual scene. When the virtual scene is rendered, the virtual lights in the scene affect the 3D geometry representing the subject and a composite picture with integrated lighting is created.