Abstract: A method of generating a composite image includes capturing a video image of a physical scene with a camera, identifying a green-screen region within the video image, identifying a viewpoint and a position and/or orientation of the green-screen region relative to the viewpoint, and generating a modified video image rendered from the viewpoint onto a display surface in which the green-screen region is replaced with an image of a virtual object. The image of the virtual object is generated by projection rendering of a model of the virtual object based on the position and/or orientation of the green-screen region relative to the viewpoint such that the virtual object is constrained within the green-screen region.

Abstract: A stereoscopic display includes a headset having a housing shaped to fit on the front of a user's face, right and left displays secured to the housing so as to be positioned before the right and left eyes of the user when the headset is worn, right and left throw lenses positioned before the left and right displays to throw images of the right and left displays to a throw distance, and right and left prism lenses positioned before the right and left displays. The right and left lenses are shaped to shift images of the right and left displays as seen by the right and left eyes inwardly toward a midline such that the vergence of the left/right eyes converge towards the center at the throw distance of the thrown display plane.

Abstract: A computer-program product may cause one or more processors to store certain files and perform certain operations. The files may include one or more audio files, each being a sonification of a signal corresponding to one or more physical sensors located within a physical building. The operations may include rendering, from a point of view selected by a user, one or more images of a virtual model of the physical building and one or more virtual sensors. Each virtual sensor may be positioned within the virtual model so as to match a location of a corresponding physical sensor of the one or more physical sensors within the physical building. The operations may further include receiving, from the user, an instruction to play at least one audio file of the one or more audio files and playing, in response to receiving the instruction, the at least one audio file.

Abstract: A system, method or compute program product for generating stereoscopic images. One of the methods includes identifying, in a first three-dimensional coordinate system of a first three-dimensional virtual environment, a location and orientation of a first virtual object that is a virtual stereoscopic display object; identifying an eyepoint pair in the first virtual environment; identifying, in a second three-dimensional coordinate system of a second three-dimensional virtual environment, a location and orientation of a second virtual object that is in the second virtual environment; for each eyepoint of the eyepoint pair, rendering an inferior image of the second virtual object; for each eyepoint of the eyepoint pair, render a superior image of the first virtual environment, comprising rendering, in the superior image for each eyepoint, the corresponding inferior image onto the virtual stereoscopic display object; and display, on a physical stereoscopic display, the first virtual environment.

Abstract: A system, method or compute program product for restricting convergence and divergence when viewing stereo 3D imagery. The technique includes receiving data representing a 3D virtual scene, receiving data indicating an eyepoint and a three-dimensional frustum rendering region with the three dimensional frustum rendering region identifying a position and orientation of a render plane, receiving data indicating a user stereo comfort region, rendering virtual objects in a first portion of the 3D virtual scene that is in the three-dimensional frustum rendering region and within the user stereo comfort region onto the render plane according to a first type of projection, and rendering virtual objects in a second portion of the 3D virtual scene that is in the three-dimensional frustum rendering region and outside the user stereo comfort region onto the render plane according to a different second type of projection.

Abstract: A method of generating a composite image includes capturing a video image of a physical scene with a camera, identifying a green-screen region within the video image, identifying a viewpoint and a position and/or orientation of the green-screen region relative to the viewpoint, and generating a modified video image rendered from the viewpoint onto a display surface in which the green-screen region is replaced with an image of a virtual object. The image of the virtual object is generated by projection rendering of a model of the virtual object based on the position and/or orientation of the green-screen region relative to the viewpoint such that the virtual object is constrained within the green-screen region.

Abstract: A computer program product may cause one or more processors to generate stereoscopic images of one or more 3D models within a 3D model space. As part of the generation of the stereoscopic images, special case surfaces that are non-flat and specularly reflective or refractive are rendered in a special manner. The special manner involves rendering a texture for the special case surface based on a third projection corresponding to a third viewpoint that is spaced from both a first viewpoint (i.e., a left eye viewpoint) and a second viewpoint (i.e., a right eye viewpoint). Accordingly, when rendering first and second images (i.e., images corresponding respectively to the first and second viewpoints), the texture corresponding to the third viewpoint may be applied to the special case surface in both the first and second images.

Abstract: A system, method or compute program product for generating composite images. One of the systems includes a capture device to capture an image of a physical environment; and one or more storage devices storing instructions that are operable, when executed by one or more processors of the system, to cause the one or more processors to: obtain an image of the physical environment as captured by the capture device, identify a visually-demarked region on a surface in the physical environment as depicted in the image, process the image to generate a composite image of the physical environment that includes a depiction of a virtual object, wherein a location of the depiction of the virtual object in the composite image is based on a location of the depiction of the visually-demarked region in the image, and cause the composite image to be displayed for a user.

Abstract: A system, method or compute program product for integrating two or more displays. One of the systems includes a stereoscopic first display; a monoscopic second display; and one or more computers configured to perform operations including receiving first data representing a 3D scene including at least one virtual 3D object, receiving second data related to the at least one virtual 3D object, obtaining third data representing the position and/or orientation of the second display relative to position and/or orientation of the first display, based on the first data, rendering the 3D scene including the at least one virtual object as a stereoscopic image on the stereoscopic first display, and based on the second data, rendering a 2D object on the monoscopic second display with the rendering varying based on the position and orientation of the second display relative to the first display provided by the third data.

Abstract: A system, method or compute program product for displaying a first image based on first image data in a display area of a first display device, receiving at least one camera-captured second image of an environment with the second image capturing at least a portion of the first image displayed in the display area, determining a location and orientation of the first display device relative to the camera, determining a portion of the second image that corresponds to the portion of the first image displayed in the display area, generating a third image that corresponds to the portion of the first image displayed on the first display device as viewed from a point of view of the camera from the first image data, and generating a composite image of the environment by replacing at least a portion of the second image with the third image, and displaying the composite image.

Abstract: A system, method or compute program product for restricting convergence and divergence when viewing stereo 3D imagery. The technique includes receiving data representing a 3D virtual scene, receiving data indicating an eyepoint and a three-dimensional frustum rendering region with the three dimensional frustum rendering region identifying a position and orientation of a render plane, receiving data indicating a user stereo comfort region, rendering virtual objects in a first portion of the 3D virtual scene that is in the three-dimensional frustum rendering region and within the user stereo comfort region onto the render plane according to a first type of projection, and rendering virtual objects in a second portion of the 3D virtual scene that is in the three-dimensional frustum rendering region and outside the user stereo comfort region onto the render plane according to a different second type of projection.

Abstract: A method of generating a composite image includes capturing a video image of a physical scene with a camera, identifying a green-screen region within the video image, identifying a viewpoint and a position and/or orientation of the green-screen region relative to the viewpoint, and generating a modified video image rendered from the viewpoint onto a display surface in which the green-screen region is replaced with an image of a virtual object. The image of the virtual object is generated by projection rendering of a model of the virtual object based on the position and/or orientation of the green-screen region relative to the viewpoint such that the virtual object is constrained within the green-screen region.

Abstract: A computer program product may cause one or more processors to generate stereoscopic images of one or more 3D models within a 3D model space. As part of the generation of the stereoscopic images, special case surfaces that are non-flat and specularly reflective or refractive are rendered in a special manner. The special manner involves rendering a texture for the special case surface based on a third projection corresponding to a third viewpoint that is spaced from both a first viewpoint (i.e., a left eye viewpoint) and a second viewpoint (i.e., a right eye viewpoint). Accordingly, when rendering first and second images (i.e., images corresponding respectively to the first and second viewpoints), the texture corresponding to the third viewpoint may be applied to the special case surface in both the first and second images.

Abstract: A system, method or compute program product for generating stereoscopic images. One of the methods includes identifying, in a first three-dimensional coordinate system of a first three-dimensional virtual environment, a location and orientation of a first virtual object that is a virtual stereoscopic display object; identifying an eyepoint pair in the first virtual environment; identifying, in a second three-dimensional coordinate system of a second three-dimensional virtual environment, a location and orientation of a second virtual object that is in the second virtual environment; for each eyepoint of the eyepoint pair, rendering an inferior image of the second virtual object; for each eyepoint of the eyepoint pair, render a superior image of the first virtual environment, comprising rendering, in the superior image for each eyepoint, the corresponding inferior image onto the virtual stereoscopic display object; and display, on a physical stereoscopic display, the first virtual environment.

Abstract: A system, method or compute program product for generating composite images. One of the systems includes a capture device to capture an image of a physical environment; and one or more storage devices storing instructions that are operable, when executed by one or more processors of the system, to cause the one or more processors to: obtain an image of the physical environment as captured by the capture device, identify a visually-demarked region on a surface in the physical environment as depicted in the image, process the image to generate a composite image of the physical environment that includes a depiction of a virtual object, wherein a location of the depiction of the virtual object in the composite image is based on a location of the depiction of the visually-demarked region in the image, and cause the composite image to be displayed for a user.

Abstract: A system, method or compute program product for restricting convergence and divergence when viewing stereo 3D imagery. The technique includes receiving data representing a 3D virtual scene, receiving data indicating an eyepoint and a three-dimensional frustum rendering region with the three dimensional frustum rendering region identifying a position and orientation of a render plane, receiving data indicating a user stereo comfort region, rendering virtual objects in a first portion of the 3D virtual scene that is in the three-dimensional frustum rendering region and within the user stereo comfort region onto the render plane according to a first type of projection, and rendering virtual objects in a second portion of the 3D virtual scene that is in the three-dimensional frustum rendering region and outside the user stereo comfort region onto the render plane according to a different second type of projection.

Abstract: A system, method or compute program product for restricting convergence and divergence when viewing stereo 3D imagery. The technique includes receiving data representing a 3D virtual scene, receiving data indicating an eyepoint and a three-dimensional frustrum rendering region with the three dimensional frustum rendering region identifying a position and orientation of a render plane, receiving data indicating a user stereo comfort region, rendering virtual objects in a first portion of the 3D virtual scene that is in the three-dimensional frustrum rendering region and within the user stereo comfort region onto the render plane according to a first type of projection, and rendering virtual objects in a second portion of the 3D virtual scene that is in the three-dimensional frustrum rendering region and outside the user stereo comfort region onto the render plane according to a different second type of projection.