Patents Assigned to Legend3D, Inc.
-
SYSTEM AND METHOD FOR REAL-TIME DEPTH MODIFICATION OF STEREO IMAGES OF A VIRTUAL REALITY ENVIRONMENT
Publication number: 20150358612Abstract: Enables real-time depth modifications to stereo images of a 3D virtual reality environment locally and for example without iterative workflow involving region designers or depth artists that includes re-rendering these images from the original 3D model. Embodiments generate a spherical translation map from the 3D model of the virtual environment; this spherical translation map is a function of the pixel shifts between left and right stereo images for each point of the sphere surrounding the viewer of the virtual environment. Modifications may be made directly to the spherical translation map, and applied directly to the stereo images, without requiring re-rendering of the scene from the complete 3D model. This process enables depth modifications to be viewed in real-time, greatly improving the efficiency of the 3D model creation, review, and update cycle.Type: ApplicationFiled: August 17, 2015Publication date: December 10, 2015Applicant: LEGEND3D, INC.Inventors: Jared SANDREW, Tony BALDRIDGE, Anthony LOPEZ, Jacqueline MCFARLAND, Scott JONES, Thomas SCHAD -
Publication number: 20150249815Abstract: A method that enables creation of a 3D virtual reality environment from a series of 2D images of a scene. Embodiments map 2D images onto a sphere to create a composite spherical image, divide the composite image into regions, and add depth information to the regions. Depth information may be generated by mapping regions onto flat or curved surfaces, and positioning these surfaces in 3D space. Some embodiments enable inserting, removing, or extending objects in the scene, adding or modifying depth information as needed. The final composite image and depth information are projected back onto one or more spheres, and then projected onto left and right eye image planes to form a 3D stereoscopic image for a viewer of the virtual reality environment. Embodiments enable 3D images to be generated dynamically for the viewer in response to changes in the viewer's position and orientation in the virtual reality environment.Type: ApplicationFiled: May 11, 2015Publication date: September 3, 2015Applicant: LEGEND3D, INC.Inventors: Jared SANDREW, Tony BALDRIDGE, Jacqueline MCFARLAND, Scott JONES, Thomas SCHAD
-
Publication number: 20150243324Abstract: The system enables conversion of black and white images to color images and/or two-dimensional images into three-dimensional images based on adding color and/or depth to images using masks for regions in the images, as well as reshaping of masks to cover objects that have moved and changed shape as the objects move in a sequence of images. Also, includes motion picture project management system for reviewers, coordinators and artists. Artists utilize image analysis and image enhancement and computer graphics processing for example to convert two-dimensional images into three-dimensional images or otherwise create or alter motion pictures. Enables the efficient management of projects related to motion pictures to enable enterprises to manage assets, control costs, predict budgets and profit margins, reduce archival storage and otherwise provide displays tailored to specific roles to increase worker efficiency.Type: ApplicationFiled: May 11, 2015Publication date: August 27, 2015Applicant: LEGEND3D, Inc.Inventors: Barry SANDREW, Tony BALDRIDGE, Jared SANDREW, Anthony LOPEZ
-
Patent number: 9113130Abstract: Multi-stage production pipeline system that may be utilized in conjunction with a motion picture project management system. The multi-stage production pipeline system includes a computer and a database. The database includes metadata associated with at least one shot or associated with regions within the plurality of images in the at least one shot, or both. The computer includes a grouping tool interface for presenting user interface elements and accepting input of the metadata associated with the at least one shot or regions within the plurality of images in the at least one shot, or both. The system enables a large studio workforce to work non-linearly on a film while maintaining a unified vision driven by key creative figures, allowing for more consistent, higher quality, faster, less expensive work product and more efficient project management techniques. The system also enables reuse of project files, masks and other production elements across projects.Type: GrantFiled: May 16, 2013Date of Patent: August 18, 2015Assignee: Legend3D, Inc.Inventors: Barry Sandrew, Jared Sandrew, Nancy Wang, Craig Cesareo, James Prola, Jill Hunt
-
Patent number: 9031383Abstract: Motion picture project management system for reviewers, coordinators and artists. Artists utilize image analysis and image enhancement and computer graphics processing for example to convert two-dimensional images into three-dimensional images or otherwise create or alter motion pictures. Enables the efficient management of projects related to motion pictures to enable enterprises to manage assets, control costs, predict budgets and profit margins, reduce archival storage and otherwise provide displays tailored to specific roles to increase worker efficiency.Type: GrantFiled: February 6, 2012Date of Patent: May 12, 2015Assignee: Legend3D, Inc.Inventors: Jared Sandrew, Anthony Lopez, Timothy Tranquill, Craig Cesareo
-
Patent number: 9007365Abstract: A line depth augmentation system and method for conversion of 2D images to 3D images. Enables adding depth to regions by altering depth of lines in the regions, for example in cell animation images or regions of limited color range. Eliminates creation of wireframe or other depth models and complex modeling of regions to match the depth of lines therein. Enables rapid conversion of two-dimensional images to three-dimensional images by enabling stereographers to quickly add/alter line depth without artifacts in images for example lines in monochrome regions. Embodiments may output a stereoscopic image pair of images with lines having desired depth, or any other three-dimensional viewing enabled image, such as an anaglyph image. Although the lines may be of a different depth than the region they appear in, the human mind interprets the monochromatic region as having depth associated with the line.Type: GrantFiled: November 27, 2012Date of Patent: April 14, 2015Assignee: Legend3D, Inc.Inventors: Barry Sandrew, Jared Sandrew, Jill Hunt, Tony Baldridge, James Prola
-
Patent number: 9007404Abstract: A tilt-based look around effect image enhancement method that enables two-dimensional images to be depth enhanced and displayed for example from a different point of view based on the tilt or orientation, and/or movement of the viewing device itself. Embodiments may further alter or otherwise utilize different parallax maps to apply depth to the image based on the display type, e.g., two-dimensional or stereoscopic display, and may dynamically utilize both algorithms on a display capable of both types of display. In addition, embodiments may display information foreign to the image when portions of the image are exposed during the look around effect, including advertisements, game information, hyperlinks or any other data not originally in the image.Type: GrantFiled: March 15, 2013Date of Patent: April 14, 2015Assignee: Legend3D, Inc.Inventors: Matt DeJohn, Jared Sandrew, Thomas Schad, Scott Jones
-
Patent number: 8953905Abstract: Movies to be colorized/depth enhanced (2D?3D) are broken into backgrounds/sets or motion/onscreen-action. Background and motion elements are combined into composite frame which becomes a visual reference database that includes data for all frame offsets used later for the computer controlled application of masks within a sequence of frames. Masks are applied to subsequent frames of motion objects based on various differentiating image processing methods, including automated mask fitting/reshaping. Colors/depths are automatically applied with masks throughout a scene from the composite background and to motion objects. Areas never exposed by motion or foreground objects may be partially or fully realistically drawn/rendered/applied to the occluded areas and applied throughout the images to generate artifact-free secondary viewpoints during 2D?3D conversion.Type: GrantFiled: June 7, 2012Date of Patent: February 10, 2015Assignee: Legend3D, Inc.Inventors: Jared Sandrew, Tony Baldridge, Anthony Lopez, Timothy Tranquill, Craig Cesareo
-
Patent number: 8897596Abstract: Motion picture scenes to be colorized/depth enhanced (2D?3D) are broken into separate elements, backgrounds/sets or motion/onscreen-action. Background and motion elements are combined into composite frame which becomes a visual reference database that includes data for all frame offsets used later for the computer controlled application of masks within a sequence of frames. Masks are applied to subsequent frames of motion objects based on various differentiating image processing methods, including automated mask fitting/reshaping. Colors and/or depths are automatically applied to masks throughout a scene from the composite background, translucent, motion objects.Type: GrantFiled: February 6, 2012Date of Patent: November 25, 2014Assignee: Legend3D, Inc.Inventors: Charles Passmore, Tony Baldridge, Barry Sandrew
-
Publication number: 20140327736Abstract: External depth map transformation method for conversion of two-dimensional images to stereoscopic images that provides increased artistic and technical flexibility and rapid conversion of movies for stereoscopic viewing. Embodiments of the invention convert a large set of highly granular depth information inherent in a depth map associated with a two-dimensional image to a smaller set of rotated planes associated with masked areas in the image. This enables the planes to be manipulated independently or as part of a group and eliminates many problems associated with importing external depth maps including minimization of errors that frequently exist in external depth maps.Type: ApplicationFiled: May 1, 2013Publication date: November 6, 2014Applicant: LEGEND3D, INC.Inventors: Matthew DeJOHN, Thomas Schad, Scott Jones
-
Publication number: 20140267235Abstract: A tilt-based look around effect image enhancement method that enables two-dimensional images to be depth enhanced and displayed for example from a different point of view based on the tilt or orientation, and/or movement of the viewing device itself. Embodiments may further alter or otherwise utilize different parallax maps to apply depth to the image based on the display type, e.g., two-dimensional or stereoscopic display, and may dynamically utilize both algorithms on a display capable of both types of display. In addition, embodiments may display information foreign to the image when portions of the image are exposed during the look around effect, including advertisements, game information, hyperlinks or any other data not originally in the image.Type: ApplicationFiled: March 15, 2013Publication date: September 18, 2014Applicant: LEGEND3D, INC.Inventors: Matt DeJohn, Jared Sandrew, Thomas Schad, Scott Jones
-
Publication number: 20140152648Abstract: Embodiments enable a three-dimensional annotation system and method that accepts desired depths for regions of input images and annotates two-dimensional/three-dimensional images with three-dimensional annotations for viewing at the desired depth(s) in any three-dimensional manner. Enables rapid and intuitive specification of desired depth and application of depth to regions in the two-dimensional images, or when editing three-dimensional images, as annotated by the three-dimensional annotations having at least one depth associated with the annotation. Enables rapid and intuitive depth augmentation or editing of an input image.Type: ApplicationFiled: November 30, 2012Publication date: June 5, 2014Applicant: LEGEND3D, INC.Inventors: Jared Sandrew, Jill Hunt
-
Publication number: 20140146037Abstract: A line depth augmentation system and method for conversion of 2D images to 3D images. Enables adding depth to regions by altering depth of lines in the regions, for example in cell animation images or regions of limited color range. Eliminates creation of wireframe or other depth models and complex modeling of regions to match the depth of lines therein. Enables rapid conversion of two-dimensional images to three-dimensional images by enabling stereographers to quickly add/alter line depth without artifacts in images for example lines in monochrome regions. Embodiments may output a stereoscopic image pair of images with lines having desired depth, or any other three-dimensional viewing enabled image, such as an anaglyph image. Although the lines may be of a different depth than the region they appear in, the human mind interprets the monochromatic region as having depth associated with the line.Type: ApplicationFiled: November 27, 2012Publication date: May 29, 2014Applicant: LEGEND 3D, INC.Inventors: Barry Sandrew, Jared Sandrew, Jill Hunt, Tony Baldridge, James Prola
-
Patent number: 8730232Abstract: Automated or semi-automated conversion of 2D movies into 3D movies through generation and use of director-style statistics or characteristics to determine which processes to apply to convert regions of images based on the director's movie making style, without requiring the creation, moving or reshaping of masks. System works by breaking a movie down into scenes and shots and identifying lighting, lens, camera moves and color schemes habitually utilized by a director. The characteristics or statistical information is stored in a database accessible by a computer over a network for example. Swarms of computers or any other architecture employing any required amount of computing power allows for the desired speed of conversion to take place. Once a director's style has been analyzed, embodiments utilize the director-style characteristics to determine the specific processes to utilize to convert the movie from 2D to 3D.Type: GrantFiled: February 1, 2011Date of Patent: May 20, 2014Assignee: Legend3D, Inc.Inventor: Charles Passmore
-
Publication number: 20130266292Abstract: Multi-stage production pipeline system that may be utilized in conjunction with a motion picture project management system. The multi-stage production pipeline system includes a computer and a database. The database includes metadata associated with at least one shot or associated with regions within the plurality of images in the at least one shot, or both. The computer includes a grouping tool interface for presenting user interface elements and accepting input of the metadata associated with the at least one shot or regions within the plurality of images in the at least one shot, or both. The system enables a large studio workforce to work non-linearly on a film while maintaining a unified vision driven by key creative figures, allowing for more consistent, higher quality, faster, less expensive work product and more efficient project management techniques. The system also enables reuse of project files, masks and other production elements across projects.Type: ApplicationFiled: May 16, 2013Publication date: October 10, 2013Applicant: LEGEND3D. Inc.Inventors: Barry Sandrew, Jared Sandrew, Nancy Wang, Craig Cesareo, James Prola, Jill Hunt
-
Patent number: 8401336Abstract: Motion picture scenes to be colorized/depth enhanced (2D->3D) are broken into separate elements, backgrounds/sets or motion/onscreen-action. Background and motion elements are combined into composite frame which becomes a visual reference database that includes data for all frame offsets used later for the computer controlled application of masks within a sequence of frames. Masks are applied to subsequent frames of motion objects based on various differentiating image processing methods, including automated mask fitting/reshaping. Colors and/or depths are automatically applied to masks throughout a scene from the composite background and to motion objects.Type: GrantFiled: December 22, 2010Date of Patent: March 19, 2013Assignee: Legend3D, Inc.Inventors: Tony Baldridge, Barry Sandrew
-
Patent number: 8396328Abstract: Motion picture scenes to be colorized/depth enhanced (2D->3D) are broken into separate elements, backgrounds/sets or motion/onscreen-action. Background and motion elements are combined into composite frame which becomes a visual reference database that includes data for all frame offsets used later for the computer controlled application of masks within a sequence of frames. Masks are applied to subsequent frames of motion objects based on various differentiating image processing methods, including automated mask fitting/reshaping. Colors and/or depths are automatically applied to masks throughout a scene from the composite background and to motion objects.Type: GrantFiled: October 27, 2010Date of Patent: March 12, 2013Assignee: Legend3D, Inc.Inventors: Barry Sandrew, Tony Baldridge
-
Patent number: 8385684Abstract: Movies to be colorized/depth enhanced (2D->3D) are broken into backgrounds/sets or motion/onscreen-action. Background and motion elements are combined into composite frame which becomes a visual reference database that includes data for all frame offsets used later for the computer controlled application of masks within a sequence of frames. Masks are applied to subsequent frames of motion objects based on various differentiating image processing methods, including automated mask fitting/reshaping. Colors/depths are automatically applied with masks throughout a scene from the composite background and to motion objects. Areas never exposed by motion or foreground objects may be partially or fully realistically drawn/rendered/applied to the occluded areas and applied throughout the images to generate artifact-free secondary viewpoints during 2D->3D conversion.Type: GrantFiled: February 17, 2011Date of Patent: February 26, 2013Assignee: Legend3D, Inc.Inventors: Jared Sandrew, Tony Baldridge, Barry Sandrew
-
Patent number: 8179475Abstract: Synchronizes a secondary audio track to a video. Analyzes the audio track of a video using audio frequency analysis or spectrograms to find distinct audio events from which to ensure synchronization of a secondary audio track. For example, commentary that mocks a character may be played immediately after a particular noise in the audio track of a video occurs such as a door slam. Keeping the secondary audio track in synch with the audio track of a video is performed by periodically searching for distinct audio events in the audio track of a video and adjusting the timing of the secondary audio track. May utilize a sound card on a computer to both analyze a DVD sound track and play and adjust timing of the secondary audio track to maintain synchronization. Secondary audio tracks may be purchased and/or downloaded and utilized to add humorous external commentary to a DVD for example.Type: GrantFiled: March 9, 2007Date of Patent: May 15, 2012Assignee: Legend3D, Inc.Inventor: Barry B. Sandrew
-
Patent number: 8160390Abstract: Motion picture scenes to be colorized/depth enhanced (2D?3D) are broken into separate elements, backgrounds/sets or motion/onscreen-action. Background and motion elements are combined into composite frame which becomes a visual reference database that includes data for all frame offsets used later for the computer controlled application of masks within a sequence of frames. Masks are applied to subsequent frames of motion objects based on various differentiating image processing methods, including automated mask fitting/reshaping. Colors and/or depths are automatically applied to masks throughout a scene from the composite background and to motion objects.Type: GrantFiled: November 1, 2010Date of Patent: April 17, 2012Assignee: Legend3D, Inc.Inventors: Barry Sandrew, Tony Baldridge