Abstract: A system, method and software for operating a virtual assistant system that runs on an electronic device where a virtual image represents a virtual assistant. Voice recognition software identifies spoken action commands. The electronic device generates an interface image, such as an avatar, that is displayed. The interface image appears three dimensional and contains enhanced effects that cause the interface image to appear, at least in part, to project above, or in front of, the screen surface of the electronic device. The interface image responds to the spoken commands. For certain spoken commands, a command response image is provided. The command response image is a three-dimensional image or video that contains enhanced effects. The command response image can be recalled from a database or created by recalling an image or video and processing that image or video to first be three-dimensional and then to contain enhanced vertical projection effects.

Abstract: A system, method and software for operating a virtual assistant system that runs on an electronic device where a virtual image represents a virtual assistant. Voice recognition software identifies spoken action commands. The electronic device generates an interface image, such as an avatar, that is displayed. The interface image appears three dimensional and contains enhanced effects that cause the interface image to appear, at least in part, to project above, or in front of, the screen surface of the electronic device. The interface image responds to the spoken commands. For certain spoken commands, a command response image is provided. The command response image is a three-dimensional image or video that contains enhanced effects. The command response image can be recalled from a database or created by recalling an image or video and processing that image or video to first be three-dimensional and then to contain enhanced vertical projection effects.

Abstract: A method of producing vertically or forward projecting three-dimensional images using virtual 3D models, wherein said 3D models are created by the simultaneous localization and depth-mapping of the physical features of real objects. A camera is used to take a first image from a first perspective, and a subsequent image from a subsequent perspective, wherein the autofocus system provides a first set of depth mapping data and a subsequent set of depth mapping data. The first set of depth mapping data and the subsequent set of depth mapping data are used to generate a disparity mapping. A virtual 3D model is created from the disparity mapping. The virtual 3D model is imaged to obtain images that can be viewed as three-dimensional. Enhanced 3D effects are added to the virtual 3D model that cause aspects of the image to appear to extend above, or in front of, the display medium.

Abstract: System, method and software for producing imagery with enhanced 3D effects that is viewed on a display medium. The imagery contains elements that appear, at least in part to extend vertically above, or in front of the surface of the display medium. To create the imagery with enhanced 3D effects, a light field camera images a scene that contains at least one subject. At a given moment in time, the subject is positioned in an initial orientation. Upon imaging, the light field camera produces light field image data that represents the scene. The light field image data is edited to add enhanced 3D effects. Once edited, the enhanced image data is played on a display medium, where the added 3D effects cause the subject to appear, at least in part, to extend vertically above, or in front of, the display medium.

Abstract: A system and method for communicating between a first person at a first location and one or more people at remote locations. A production set is established at the first location where the first person is imaged with stereoscopic video cameras. The stereoscopic footage is digitally enhanced with 3D effects to create a production video file. The production video file is transmitted to an electronic device at one or more remote locations. The production video file is played and creates images of the first person at the first location. On a display screen at the remote locations, the images appear three dimensional to the remote viewers. Furthermore, the images appear to extend in front of, or above, the display screen of the electronic device.

Abstract: A system and method of interacting with a virtual object in a virtual environment using physical movement. The virtual scene contains a 3D object that appears to extend forward or above the plane of the display. A sensor array is provided that monitors an area proximate the display. The sensor array can detect the presence and position of an object that enters the area. Action points are programmed in, on, or near the virtual objects. Each action point has virtual coordinates in said virtual scene that correspond to real coordinates within the monitored area. Subroutines are activated when the sensor array detects an object that moves to real coordinates that correspond to the virtual coordinates of the action points.

Abstract: A system, method and software for producing 3D effects in a video of a physical scene. The 3D effects can be observed when the video is viewed, either during a live stream or later when viewing the recorded video. A reference plane is defined. The reference plane has peripheral boundaries. A live event is viewed with stereoscopic video cameras. The stereoscopic camera viewpoints are calculated that enable the event to be recorded within the peripheral boundaries of the reference plane. The footage from the stereoscopic video cameras is digitally altered prior to being imaged. The altering of the footage includes bending, tapering, stretching and/or tilting a portion of the footage in real time. Once the footage is altered, a common set of boundaries are set for superimposed footage to create a final video production.

Abstract: A system, method and software for producing a virtual scene to be viewed on an electronic display. A virtual reference plane is defined. The reference plane has peripheral boundaries. A virtual object is positioned above the reference plane in the virtual scene. Stereoscopic camera viewpoints are calculated that enable the virtual object to be imaged with the reference plane within the peripheral boundaries of the reference plane. The virtual object is digitally altered before and/or after being stereoscopically imaged. The altering includes bending, tapering or tilting a portion of the virtual object, and/or tilting a portion of the reference plane. A common set of boundaries are set for a superimposed image to create a final image.

Abstract: A method of producing vertically or forward projecting three-dimensional images using virtual 3D models, wherein said 3D models are created by the simultaneous localization and depth-mapping of the physical features of real objects. A camera is used to take a first image from a first perspective, and a subsequent image from a subsequent perspective, wherein the autofocus system provides a first set of depth mapping data and a subsequent set of depth mapping data. The first set of depth mapping data and the subsequent set of depth mapping data are used to generate a disparity mapping. A virtual 3D model is created from the disparity mapping. The virtual 3D model is imaged to obtain images that can be viewed as three-dimensional. Enhanced 3D effects are added to the virtual 3D model that cause aspects of the image to appear to extend above, or in front of, the display medium.

Abstract: A system and method for operating a virtual assistant system run on an electronic device with a visual image representing the virtual assistant. Voice recognition software identifies spoken action commands. The electronic device generates an interface image, such as an avatar, that is displayed. The interface image appears three dimensional and contains enhanced 3D effects that cause the interface image to appear, at least in part, to extend out beyond the screen surface of the electronic device. The interface image is interactive and responds to the spoken commands. For certain spoken commands, a command response image is provided. The command response image is a three-dimensional image or video that contains enhanced 3D effects. The command response image can be recalled from a database or created by recalling an image or video and processing that image or video to first be three-dimensional and then to contain enhanced 3D effect.

Abstract: A system and method for communicating between a first person at a first location and one or more people at remote locations. A production set is established at the first location where the first person is imaged with stereoscopic video cameras. The stereoscopic footage is digitally enhanced with 3D effects to create a production video file. The production video file is transmitted to an electronic device at one or more remote locations. The production video file is played and creates images of the first person at the first location. On a display screen at the remote locations, the images appear three dimensional to the remote viewers. Furthermore, the images appear to extend in front of, or above, the display screen of the electronic device.

Abstract: A system and method of providing a virtual avatar to accompany audio signals being broadcast from an electronic device that has a display screen. A virtual avatar model is created. The virtual avatar model is altered in real time in response to audio signals being broadcast from the electronic device. A 3D stereoscopic or auto-stereoscopic video file is created using the virtual avatar model while the virtual avatar model is responding to the audio signals. The 3D video file is played on the display screen of the electronic device. When viewed, the 3D video file shows an avatar that appears, at least in part, to a viewer to be three-dimensional. Furthermore, the avatar appears to extend out from the display screen. The result is a three-dimensional avatar that appears to extend out of a display screen, wherein movements of the avatar are synchronized to audio signals that are being broadcast.

Abstract: A system and method of interacting with a virtual object in a virtual environment using physical movement. The virtual scene contains a 3D object that appears to extend forward or above the plane of the display. A sensor array is provided that monitors an area proximate the display. The sensor array can detect the presence and position of an object that enters the area. Action points are programmed in, on, or near the virtual objects. Each action point has virtual coordinates in said virtual scene that correspond to real coordinates within the monitored area. Subroutines are activated when the sensor array detects an object that moves to real coordinates that correspond to the virtual coordinates of the action points.

Abstract: System, method and software for producing imagery with enhanced 3D effects that is viewed on a display medium. The imagery contains elements that appear, at least in part to extend vertically above, or in front of the surface of the display medium. To create the imagery with enhanced 3D effects, a light field camera images a scene that contains at least one subject. At a given moment in time, the subject is positioned in an initial orientation. Upon imaging, the light field camera produces light field image data that represents the scene. The light field image data is edited to add enhanced 3D effects. Once edited, the enhanced image data is played on a display medium, where the added 3D effects cause the subject to appear, at least in part, to extend vertically above, or in front of, the display medium.

Abstract: A system, method and software for producing 3D effects in a video of a physical scene. The 3D effects can be observed when the video is viewed, either during a live stream or later when viewing the recorded video. A reference plane is defined. The reference plane has peripheral boundaries. A live event is viewed with stereoscopic video cameras. The stereoscopic camera viewpoints are calculated that enable the event to be recorded within the peripheral boundaries of the reference plane. The footage from the stereoscopic video cameras is digitally altered prior to being imaged. The altering of the footage includes bending, tapering, stretching and/or tilting a portion of the footage in real time. Once the footage is altered, a common set of boundaries are set for superimposed footage to create a final video production.

Abstract: A system, method and software for producing a virtual scene to be viewed on an electronic display. A virtual reference plane is defined. The reference plane has peripheral boundaries. A virtual object is positioned above the reference plane in the virtual scene. Stereoscopic camera viewpoints are calculated that enable the virtual object to be imaged with the reference plane within the peripheral boundaries of the reference plane. The virtual object is digitally altered before and/or after being stereoscopically imaged. The altering includes bending, tapering or tilting a portion of the virtual object, and/or tilting a portion of the reference plane. A common set of boundaries are set for a superimposed image to create a final image.