Patents Assigned to Lucasfilm Entertainment Company Ltd.
  • Editable character action user interfaces
    Patent number: 9030477
    Abstract: A system includes a computing device that includes a memory configured to store instructions. The computing device also includes a processor configured to execute the instructions to perform a method that includes defining at least one of a location in a virtual scene and a time represented in a timeline as being associated with a performance of an animated character. The method also includes aggregating data that represents actions of the animation character for at least one of the defined location and the defined time. The method also includes presenting a user interface that includes a representation of the aggregated actions. The representation is editable to adjust at least one action included in the aggregation.
    Type: Grant
    Filed: June 24, 2011
    Date of Patent: May 12, 2015
    Assignee: Lucasfilm Entertainment Company Ltd.
    Inventors: Adam Schnitzer, Joshua Goldenberg, Kent Oberheu, Domenico Porcino, Louise Rasmussen
  • Configuring stereo cameras
    Patent number: 9025007
    Abstract: A computer-implemented method for configuring stereo cameras includes detecting, in a computer system, a relocation of a manipulator in a virtual set. The manipulator defined in the computer system to specify an aspect of the virtual set. The method includes receiving an input in the computer system, the input specifying an aspect of a projection environment. The method includes configuring, using the relocation and the input, first and second cameras to capture a stereo view of a scene such that the stereo view is compatible for being projected in the projection environment.
    Type: Grant
    Filed: April 28, 2009
    Date of Patent: May 5, 2015
    Assignee: Lucasfilm Entertainment Company Ltd.
    Inventors: Jed Parsons, Arkell Rasiah, Douglas Moore, Tom Martinek
  • Post-render motion blur
    Patent number: 9025902
    Abstract: A method of applying a post-render motion blur to an object may include receiving a first image of the object. The first image need not be motion blurred, and the first image may include a first pixel and rendered color information for the first pixel. The method may also include receiving a second image of the object. The second image may be motion blurred, and the second image may include a second pixel and a location of the second pixel before the second image was motion blurred. The method may additionally include locating the first pixel in the first image using the location of the second pixel before the second image was motion blurred. The method may further include coloring the second pixel using the rendered color information for the first pixel.
    Type: Grant
    Filed: September 25, 2013
    Date of Patent: May 5, 2015
    Assignee: Lucasfilm Entertainment Company Ltd.
    Inventors: Victor Schutz, Patrick Conran
  • Visual tracking framework
    Patent number: 9002064
    Abstract: A computer program product tangibly embodied in a computer-readable storage medium includes instructions that when executed by a processor perform a method. The method includes identifying a frame of a video sequence, transforming a model into an initial guess for how the region appears in the frame, performing an exhaustive search of the frame, performing a plurality of optimization procedures, wherein at least one additional model parameter is taken into account as each subsequent optimization procedure is initiated. A system includes a computer readable storage medium, a graphical user interface, an input device, a model for texture and shape of the region, the model generated using the video sequence and stored in the computer readable storage medium, and a solver component.
    Type: Grant
    Filed: November 4, 2013
    Date of Patent: April 7, 2015
    Assignee: Lucasfilm Entertainment Company Ltd.
    Inventors: Christoph Bregler, Kiran S. Bhat, Brett A. Allen
  • Interaction between 3D animation and corresponding script
    Patent number: 9003287
    Abstract: Interaction between a 3D animation and a corresponding script includes: displaying a user interface that includes at least a 3D animation area and a script area, the 3D animation area including (i) a 3D view area for creating and playing a 3D animation and (ii) a timeline area for visualizing actions by one or more 3D animation characters, the script area comprising one or more objects representing lines from a script having one or more script characters; receiving a first user input corresponding to a user selecting at least one of the objects from the script area for assignment to a location in the timeline area; generating a timeline object at the location in response to the first user input, the timeline object corresponding to the selected object; and associating audio data with the generated timeline object, the audio data corresponding to a line represented by the selected object.
    Type: Grant
    Filed: November 18, 2011
    Date of Patent: April 7, 2015
    Assignee: Lucasfilm Entertainment Company Ltd.
    Inventors: Joshua Goldenberg, Louise Rasmussen, Adam Schnitzer, Domenico Porcino, George Lucas, Brett A. Allen
  • Constraint scenarios for retargeting actor motion
    Patent number: 9001132
    Abstract: A computer-implemented method for providing retargeting of actor motion includes: receiving, in a computer system, an input generated by user selection of at least one of multiple real-time constraint scenarios, each real-time constraint scenario corresponding to a relationship between motion capture information from an actor and a position or movement of a character driven by the motion capture information; activating, based on the selected real-time constraint scenario, one or more of multiple limb solvers for the character which determines at least a first joint angle for a corresponding character limb; registering, for at least one character limb where the corresponding limb solver is not activated, a corresponding joint angle from the motion capture information as a second joint angle; and determining a root location for the character based on at least the first and second joint angles.
    Type: Grant
    Filed: December 13, 2011
    Date of Patent: April 7, 2015
    Assignee: Lucasfilm Entertainment Company Ltd.
    Inventors: Kevin Wooley, Kiran S. Bhat, Michael Sanders
  • System for using angle-weighted normals and flood-filling in geometric modeling
    Patent number: 9001122
    Abstract: A first geometry and a second geometry are accessed. They are positioned so that the first geometry and the second geometry at least in part intersect. The first geometry is divided into portions based on the intersection with the second geometry. At least a first portion of the first geometry is classified as being on one side of the second geometry. At least a second portion of the first geometry is classified as being on another side of the second geometry. At least a third portion of the first geometry is unclassified. The classifying includes comparing an angle weighted normal of a face with a property of the second geometry. The third portion is reclassified as either above the second geometry or below the second geometry according to the classification of a neighboring portion.
    Type: Grant
    Filed: August 2, 2012
    Date of Patent: April 7, 2015
    Assignee: Lucasfilm Entertainment Company Ltd.
    Inventor: Jeffrey D. Smith
  • REAL-TIME PERFORMANCE CAPTURE WITH ON-THE-FLY CORRECTIVES
    Publication number: 20150084950
    Abstract: Techniques for facial performance capture using an adaptive model are provided herein. For example, a computer-implemented method may include obtaining a three-dimensional scan of a subject and a generating customized digital model including a set of blendshapes using the three-dimensional scan, each of one or more blendshapes of the set of blendshapes representing at least a portion of a characteristic of the subject. The method may further include receiving input data of the subject, the input data including video data and depth data, tracking body deformations of the subject by fitting the input data using one or more of the blendshapes of the set, and fitting a refined linear model onto the input data using one or more adaptive principal component analysis shapes.
    Type: Application
    Filed: December 26, 2013
    Publication date: March 26, 2015
    Applicant: LucasFilm Entertainment Company Ltd.
    Inventors: Hao LI, Jihun YU, Yuting YE, Christoph BREGLER
  • POST-RENDER MOTION BLUR
    Publication number: 20150084991
    Abstract: A method of applying a post-render motion blur to an object may include receiving a first image of the object. The first image need not be motion blurred, and the first image may include a first pixel and rendered color information for the first pixel. The method may also include receiving a second image of the object. The second image may be motion blurred, and the second image may include a second pixel and a location of the second pixel before the second image was motion blurred. The method may additionally include locating the first pixel in the first image using the location of the second pixel before the second image was motion blurred. The method may further include coloring the second pixel using the rendered color information for the first pixel.
    Type: Application
    Filed: September 25, 2013
    Publication date: March 26, 2015
    Applicant: LUCASFILM ENTERTAINMENT COMPANY, LTD.
    Inventors: VICTOR SCHUTZ, PATRICK CONRAN
  • Deforming a skin representation using muscle geometries
    Patent number: 8988435
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, are disclosed for animations that simulate skin deformation relative to a muscle. Displacement of a skin representation in response to deformation of a muscle representation and sliding of the skin representation over the deformed muscle representation can be determined quickly and interactively by monitoring changes in position and scale of defining ring elements of the muscle representation's geometry. The determined in displacements can be constrained to prevent portions of the displaced skin representation from sinking into the underlying muscle representation's geometry.
    Type: Grant
    Filed: September 6, 2013
    Date of Patent: March 24, 2015
    Assignee: Lucasfilm Entertainment Company Ltd.
    Inventor: Julien F. Cohen Bengio
  • THREE-DIMENSIONAL MOTION CAPTURE
    Publication number: 20150077418
    Abstract: In one general aspect, a method is described. The method includes generating a positional relationship between one or more support structures having at least one motion capture mark and at least one virtual structure corresponding to geometry of an object to be tracked and positioning the support structures on the object to be tracked. The support structures has sufficient rigidity that, if there are multiple marks, the marks on each support structure maintain substantially fixed distances from each other in response to movement by the object. The method also includes determining an effective quantity of ray traces between one or more camera views and one or more marks on the support structures, and estimating an orientation of the virtual structure by aligning the determined effective quantity of ray traces with a known configuration of marks on the support structures.
    Type: Application
    Filed: November 21, 2014
    Publication date: March 19, 2015
    Applicant: LUCASFILM ENTERTAINMENT COMPANY, LTD.
    Inventors: Steve Sullivan, Colin Davidson, Michael Sanders, Kevin Wooley
  • DYNAMIC LIGHTING
    Publication number: 20150062863
    Abstract: A movie set can include light sources each producing a light corresponding to a light channel, at least one high-frame rate camera, and a controller connected to the light sources and camera to synchronize the camera and light sources. The number of light channels can be proportional to the frame rate. For example, if the filming frame rate is 120 frames per second (fps) and the playback frame rate is 24 fps, then 5 light channels can be used. In this example, for every one playback frame, 5 frames were filmed by the high frame rate camera. The controller modulates the light channels such that each of the 5 frames has different lighting characteristics. In post-production, contributions from each of the light channels can be included or excluded from the final frame. An optical flow algorithm can be used to stitch together frames with different dynamic light characteristics.
    Type: Application
    Filed: September 5, 2013
    Publication date: March 5, 2015
    Applicant: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventors: Kim Libreri, Curt Miyashiro
  • Controlling a virtual camera
    Patent number: 8964052
    Abstract: Among other aspects, on computer-implemented method includes: receiving at least one command in a computer system from a handheld device; positioning a virtual camera and controlling a virtual scene according to the command; and in response to the command, generating an output to the handheld device for displaying a view of the virtual scene as controlled on a display of the handheld device, the view captured by the virtual camera as positioned.
    Type: Grant
    Filed: December 30, 2010
    Date of Patent: February 24, 2015
    Assignee: LucasFilm Entertainment Company, Ltd.
    Inventors: Kevin Wooley, Michael Sanders, Steve Sullivan, Spencer Reynolds, Brian Cantwell
  • User wearable viewing devices
    Patent number: 8947512
    Abstract: An apparatus includes a user wearable viewing device for assisting the user to view a representation of three dimensional content. The user wearable viewing device is assigned a unique identifier to provide a private viewing experience for the user.
    Type: Grant
    Filed: July 6, 2011
    Date of Patent: February 3, 2015
    Assignee: Lucasfilm Entertainment Company Ltd.
    Inventors: Eric R. Johnston, David Bullock
  • Quality assurance testing of virtual environments
    Patent number: 8941643
    Abstract: A system includes a computing device that includes a memory configured to store instructions. The computing device also includes a processor configured to execute the instructions to perform a method that includes projecting a first simulated ray from a moveable character within an interactive virtual environment to intersect one or more virtual surfaces represented in the environment. The method also includes rendering a graphical representation of the first simulated ray to identify the absence of an intersection with the one or more virtual surfaces represented in the interactive virtual environment.
    Type: Grant
    Filed: December 28, 2010
    Date of Patent: January 27, 2015
    Assignee: Lucasfilm Entertainment Company Ltd.
    Inventors: Jeremy Randolph, Matthew Bishop, Tzuen Wu, Eric R. Johnston
  • Model production for animation libraries
    Patent number: 8941665
    Abstract: A computer-implemented method includes selecting a subset of images from a set of captured images. A surface feature of one object is represented in the content of each selected subset image. The method also includes decomposing the surface feature content of each selected image to produce a model of representations of the object.
    Type: Grant
    Filed: March 21, 2012
    Date of Patent: January 27, 2015
    Assignee: Lucasfilm Entertainment Company Ltd.
    Inventors: Steve Sullivan, Francesco Callari
  • Controlling operations for execution
    Patent number: 8943442
    Abstract: A computer-implemented method of controlling operations for execution includes displaying, in a display device area that controls a process of operations, a current container providing at least a first operation to the process, and a linear sequence representing parent containers of the current container organized in a hierarchy. The method includes receiving, in a system generating the display device area, a partial-performance request identifying a subset of the parent containers defined between the current container and a level in the hierarchy. The method includes performing, in response to the partial-performance request, the first operation and those of the operations that the subset of the parent containers provide to the process.
    Type: Grant
    Filed: November 23, 2010
    Date of Patent: January 27, 2015
    Assignee: Lucasfilm Entertainment Company Ltd.
    Inventor: Kent Oberheu
  • Character animation recorder
    Patent number: 8941666
    Abstract: A system includes a computing device that includes a memory configured to store instructions. The computing device also includes a processor configured to execute the instructions to perform a method that includes representing animation states of a virtual character in editable graphical representations. Each animation state represents each individual action of the character for an instance in time. The method also includes storing data that represents one or more changes in the animation states of the virtual character from the editable graphical representations. A pose of the virtual character is reconstructable upon retrieval of the stored data.
    Type: Grant
    Filed: March 24, 2011
    Date of Patent: January 27, 2015
    Assignee: Lucasfilm Entertainment Company Ltd.
    Inventor: Lucas A. Kovar
  • Combining multiple session content for animation libraries
    Patent number: 8928674
    Abstract: A computer-implemented method includes comparing content captured during one session and content captured during another session. A surface feature of an object represented in the content of one session corresponds to a surface feature of an object represented in the content of the other session. The method also includes substantially aligning the surface features of the sessions and combining the aligned content.
    Type: Grant
    Filed: June 8, 2012
    Date of Patent: January 6, 2015
    Assignee: Lucasfilm Entertainment Company Ltd.
    Inventors: Steve Sullivan, Francesco G. Callari
  • Presenting multiple viewer content on a single screen
    Patent number: 8922631
    Abstract: A system includes a computing device that includes a memory configured to store instructions. The computing device also includes a processor configured to execute the instructions to perform a method that includes presenting a representation of three dimensional content on a single display. The three dimensional content representation is presented as a shared viewing experience for at least two viewers. The method also includes presenting a representation of two dimensional content on the single display to a first viewer of the at least two viewers. The two dimensional representation is presented as a private viewing experience for the first viewer and a second viewer of the at least two viewers is visually isolated from the presented two dimensional content representation.
    Type: Grant
    Filed: July 6, 2011
    Date of Patent: December 30, 2014
    Assignee: Lucasfilm Entertainment Company Ltd.
    Inventors: Eric R. Johnston, David Bullock