Lucasfilm Patents

Lucasfilm Ltd. produced the Star Wars and Indiana Jones motion pictures. The company was acquired by the Walt Disney Company in 2012.

Lucasfilm Patents by Type

  • Publication number: 20170178382
    Abstract: A multi-channel tracking pattern is provided along with techniques and systems for performing motion capture using the multi-channel tracking pattern. The multi-channel tracking pattern includes a plurality of shapes having different colors on different portions of the pattern. The portions with the unique shapes and colors allow a motion capture system to track motion of an object bearing the pattern across a plurality of video frames.
    Type: Application
    Filed: February 11, 2016
    Publication date: June 22, 2017
    Applicant: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventor: John Levin
  • Patent number: 9684993
    Abstract: A method includes receiving a first motion path for an object, where an orientation of the object is not aligned with the first motion path for the object for at least a portion of the first motion path. The method also includes receiving a first motion path for a virtual camera and determining a speed of the object along the first motion path for the object. The method additionally includes calculating a second motion path for the object based on the speed of the object along the first motion path for the object and the orientation of the object, where the second motion path of the object is aligned with second motion path. The method further includes calculating a second motion path for the virtual camera based on a difference between the first motion path of the object and the second motion path of the object.
    Type: Grant
    Filed: September 23, 2015
    Date of Patent: June 20, 2017
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventor: David Weitzberg
  • Patent number: 9672417
    Abstract: In one aspect, a computer implemented method of motion capture, the method includes tracking the motion of a dynamic object bearing a pattern configured such that a first portion of the patterns is tracked at a first resolution and a second portion of the pattern is tracked at a second resolution. The method further includes causing data representing the motion to be stored to a computer readable medium.
    Type: Grant
    Filed: December 31, 2015
    Date of Patent: June 6, 2017
    Assignee: LUCASFILM ENTERTAINMENT COMPANY, LTD.
    Inventors: Kevin Wooley, Ronald Mallet
  • Patent number: 9665966
    Abstract: Representing a connection between objects in a simulation includes identifying, on a source object to be used in a simulation process, a source point that is available for creating a connection to another object. On a target object, a target point is identified for use in creating the connection. At least one of the source object and the target object is a rigid object. A spring element having respective ends at the source point and the target point is created, and at least one property thereof is set. A system includes an animation module, and a simulation module that performs a simulation process involving creating, and setting a property of, a spring element having respective ends at a source point on the source object and a target point on the target object.
    Type: Grant
    Filed: December 1, 2006
    Date of Patent: May 30, 2017
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventors: Brice Criswell, Karin Cooper, Don Hatch, James Robert Tooley
  • Publication number: 20170148201
    Abstract: Performance capture systems and techniques are provided for capturing a performance of a subject and reproducing an animated performance that tracks the subject's performance. For example, systems and techniques are provided for determining control values for controlling an animation model to define features of a computer-generated representation of a subject based on the performance. A method may include obtaining input data corresponding to a pose performed by the subject, the input data including position information defining positions on a face of the subject. The method may further include obtaining an animation model for the subject that includes adjustable controls that control the animation model to define facial features of the computer-generated representation of the face, and matching one or more of the positions on the face with one or more corresponding positions on the animation model.
    Type: Application
    Filed: February 3, 2017
    Publication date: May 25, 2017
    Applicant: Lucasfilm Entertainment Company Ltd.
    Inventors: Kiran Bhat, Michael Koperwas, Jeffery Yost, Ji Hun Yu, Sheila Santos
  • Patent number: 9641830
    Abstract: Methods and systems are disclosed for calibrating a camera using a calibration target apparatus that contains at least one fiducial marking on a planar surface. The set of all planar markings on the apparatus are distinguishable. Parameters of the camera are inferred from at least one image of the calibration target apparatus. In some embodiments, pixel coordinates of identified fiducial markings in an image are used with geometric knowledge of the apparatus to calculate camera parameters.
    Type: Grant
    Filed: April 8, 2014
    Date of Patent: May 2, 2017
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventors: Ronald Mallet, Jason Snell, Jeff Saltzman, Douglas Moore, Paige Warner
  • Patent number: 9626786
    Abstract: A handheld device includes: an input control configured to control and modify a virtual scene including a virtual camera; and a display that shows a representation of the controlled and modified virtual scene generated by the virtual camera. A system includes: a computer system configured to execute program instructions for generating a virtual scene including a virtual camera; and handheld device configured to communicate with the computer system for controlling and modifying the virtual scene, the handheld device comprising: an input control configured to control and modify the virtual scene; and a display that shows a representation of the controlled and modified virtual scene generated by the virtual camera.
    Type: Grant
    Filed: December 30, 2010
    Date of Patent: April 18, 2017
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventors: Spencer Reynolds, Michael Sanders, Kevin Wooley, Steve Sullivan, Adam Schnitzer
  • Publication number: 20170084072
    Abstract: A method includes receiving a first motion path for an object, where an orientation of the object is not aligned with the first motion path for the object for at least a portion of the first motion path. The method also includes receiving a first motion path for a virtual camera and determining a speed of the object along the first motion path for the object. The method additionally includes calculating a second motion path for the object based on the speed of the object along the first motion path for the object and the orientation of the object, where the second motion path of the object is aligned with second motion path. The method further includes calculating a second motion path for the virtual camera based on a difference between the first motion path of the object and the second motion path of the object.
    Type: Application
    Filed: September 23, 2015
    Publication date: March 23, 2017
    Applicant: LUCASFILM ENTERTAINMENT COMPANY, LTD.
    Inventor: David Weitzberg
  • Patent number: 9600742
    Abstract: Performance capture systems and techniques are provided for capturing a performance of a subject and reproducing an animated performance that tracks the subject's performance. For example, systems and techniques are provided for determining control values for controlling an animation model to define features of a computer-generated representation of a subject based on the performance. A method may include obtaining input data corresponding to a pose performed by the subject, the input data including position information defining positions on a face of the subject. The method may further include obtaining an animation model for the subject that includes adjustable controls that control the animation model to define facial features of the computer-generated representation of the face, and matching one or more of the positions on the face with one or more corresponding positions on the animation model.
    Type: Grant
    Filed: May 5, 2015
    Date of Patent: March 21, 2017
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventors: Kiran Bhat, Michael Koperwas, Jeffery Yost, Ji Hun Yu, Sheila Santos
  • Publication number: 20170046865
    Abstract: Systems and techniques are provided for performing animation motion capture of objects within an environment. For example, a method may include obtaining input data including a three-dimensional point cloud of the environment. The three-dimensional point cloud is generated using a three-dimensional laser scanner including multiple laser emitters and multiple laser receivers. The method may further include obtaining an animation model for an object within the environment. The animation model includes a mesh, an animation skeleton rig, and adjustable controls that control the animation skeleton rig to define a position of one or more faces of the mesh. The method may further include determining a pose of the object within the environment. Determining a pose includes fitting the one or more faces of the mesh to one or more points of a portion of the three-dimensional point cloud. The portion of the three-dimensional point cloud corresponds to the object in the environment.
    Type: Application
    Filed: August 14, 2015
    Publication date: February 16, 2017
    Applicant: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventor: Brian Cantwell
  • Patent number: 9558578
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for animation. An animation application creates an animation environment. An input device receives input from a user to the animation application. An output device displays output to the user of the animation application. The animation application is configured to have a mode of operation that includes displaying, through the output device, a 3D animation view of the animation environment overlain by a 2D edit view of the animation environment.
    Type: Grant
    Filed: March 14, 2013
    Date of Patent: January 31, 2017
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventors: Adam Schnitzer, Max S-Han Chen, Domenico Porcino, Louise Rasmussen, Greg James, Jonathan Stone, Steve Sullivan, Kent Oberheu
  • Patent number: 9519976
    Abstract: A stereoscopic camera calibration target includes: first illumination points on a first surface; second illumination points on a second surface, the first and second surfaces being planar, parallel to each other, and spaced from each other; and circuitry that sets a strobe frequency of the first and second illumination points. A method includes: moving a calibration target in front of a stereoscopic camera, the calibration target comprising first points on a first surface and second points on a second surface, the first and second surfaces being planar, parallel to each other, and spaced from each other; capturing, using the stereoscopic camera, an image sequence of the calibration target, the image sequence comprising pairs of left and right images of at least some of the first and second points; determining a calibration value for the stereoscopic camera using the image sequence; and processing the image sequence using the calibration value.
    Type: Grant
    Filed: January 28, 2011
    Date of Patent: December 13, 2016
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventor: Jeffrey Saltzman
  • Patent number: 9508178
    Abstract: A method of generating an animation rig for a 3-D computing environment may include accessing a plurality of blocks, each representing a particular rig element, and including interfaces that govern interactions with other rig elements and information for generating a portion of the animation rig corresponding to the particular rig element represented by the block. The method may also include receiving a selection of a first block that includes a first interface and first information and represents a first rig element, and receiving a selection of a second block that includes a second interface and second information and represents a second rig element. The method may additionally include receiving an instruction to connect the first interface to the second interface, generating the animation rig using the first information and the second information, and providing the animation rig to the 3-D computing environment.
    Type: Grant
    Filed: July 19, 2013
    Date of Patent: November 29, 2016
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventors: Michael Justin Lee Jutan, Rachel Rose, John Doublestein
  • Patent number: 9508179
    Abstract: A method of generating an animation rig for a three-dimensional (3-D) computing environment may include providing a rig generation environment that includes a library storing a plurality of blocks. Each of the plurality of blocks may represent particular rig elements and include information for generating the rig elements in the 3-D computing environment along with a first icon that is visually representative of the particular rig elements. The method may also include receiving and displaying two or more blocks in the rig generation environment, and receiving one or more graphical connections between the blocks. The method may additionally include generating the animation rig using the information of each of the two or more blocks and sending the animation rig from the rig generation environment to the 3-D computing environment.
    Type: Grant
    Filed: July 19, 2013
    Date of Patent: November 29, 2016
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventors: Michael Justin Lee Jutan, Rachel Rose, Darby Johnston
  • Patent number: 9508176
    Abstract: A 3D animation environment that includes an animation object is generated. A movement speed is assigned to object the 3D animation environment. An animation path containing at least first and second waypoints is generated. An animation sequence is generated by identifying a first section of the animation path connected to the first waypoint. A first animation of the animation object is generated in which the animation object moves along the first section of the path at the movement speed. A spatial gap in the animation path is identified between the first and second waypoints. A second animation of the animation object is generated in which the animation object moves, by keyframe animation, from the first waypoint to the second waypoint. A third animation of the animation object is generated in which the animation object moves along at least a second portion of the path at the movement speed.
    Type: Grant
    Filed: November 16, 2012
    Date of Patent: November 29, 2016
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventors: George Lucas, Domenico Porcino, Adam Schnitzer, Louise Rasmussen, Kent Oberheu
  • Patent number: 9478105
    Abstract: Among other disclosed subject matter, a computer program product is tangibly embodied in a computer-readable storage medium and includes instructions that when executed by a processor perform a method for detecting collision between objects. The method includes identifying a first edge of a first object, and a second edge of a second object, presented on a display, the second object associated with a transformation. The method includes performing an inverse of the transformation on the first object while not performing the transformation on the second object. The method includes generating an output on the display that indicates whether the first and second objects collide, the output based on performing the inverse of the transformation.
    Type: Grant
    Filed: March 17, 2009
    Date of Patent: October 25, 2016
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventors: Rony Goldenthal, Jonathan Hoof
  • Publication number: 20160284136
    Abstract: A system and method facilitating a user to manipulate a virtual reality (VR) environment are disclosed. The user may provide an input via a touch sensitive surface of a computing device associated with the user to bind a virtual object in the VR environment to the computing device. The user may then move and/or rotate the computing device to cause the bound virtual object to move and/or rotate in the VR environment accordingly. In some examples, the bound virtual object may cast a ray into the VR environment. The movement and/or rotation of the virtual object controlled by the computing device in those examples can change the direction of the ray. In some examples, the virtual object may include a virtual camera. In those examples, the user may move and/or rotate the virtual camera in the VR environment by moving and/or rotate the computing device.
    Type: Application
    Filed: September 30, 2015
    Publication date: September 29, 2016
    Applicant: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventors: Darby Johnston, Ian Wakelin
  • Publication number: 20160283081
    Abstract: A system and method for controlling a view of a virtual reality (VR) environment via a computing device with a touch sensitive surface are disclosed. In some examples, a user may be enabled to augment the view of the VR environment by providing finger gestures to the touch sensitive surface. In one example, the user is enabled to call up a menu in the view of the VR environment. In one example, the user is enabled to switch the view of the VR environment displayed on a device associated with another user to a new location within the VR environment. In some examples, the user may be enabled to use the computing device to control a virtual camera within the VR environment and have various information regarding one or more aspects of the virtual camera displayed in the view of the VR environment presented to the user.
    Type: Application
    Filed: September 30, 2015
    Publication date: September 29, 2016
    Applicant: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventors: Darby Johnston, Ian Wakelin
  • Patent number: 9430869
    Abstract: The subject matter of this specification can be embodied in, among other things, a method that includes generating intermediate values from an evaluation of one or more static expressions within shader programming code that is configured to modify an appearance of an image, compressing the intermediate values based on a determination of which intermediate values are duplicative, and storing the compressed intermediate values in a buffer accessible to an image rendering application.
    Type: Grant
    Filed: February 8, 2013
    Date of Patent: August 30, 2016
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventors: Charlie A. Kilpatrick, Brian W. Smith
  • Patent number: 9424679
    Abstract: In one general aspect, a method is described. The method includes generating a positional relationship between one or more support structures having at least one motion capture mark and at least one virtual structure corresponding to geometry of an object to be tracked and positioning the support structures on the object to be tracked. The support structures has sufficient rigidity that, if there are multiple marks, the marks on each support structure maintain substantially fixed distances from each other in response to movement by the object. The method also includes determining an effective quantity of ray traces between one or more camera views and one or more marks on the support structures, and estimating an orientation of the virtual structure by aligning the determined effective quantity of ray traces with a known configuration of marks on the support structures.
    Type: Grant
    Filed: November 21, 2014
    Date of Patent: August 23, 2016
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventors: Steve Sullivan, Colin Davidson, Michael Sanders, Kevin Wooley
  • Publication number: 20160227262
    Abstract: Systems and techniques are provided for switching between different modes of a media content item. A media content item may include a movie that has different modes, such as a cinematic mode and an interactive mode. For example, a movie may be presented in a cinematic mode that does not allow certain user interactions with the movie. The movie may be switched to an interactive mode during any point of the movie, allowing a viewer to interact with various aspects of the movie. The movie may be displayed using different formats and resolutions depending on which mode the movie is being presented.
    Type: Application
    Filed: March 31, 2016
    Publication date: August 4, 2016
    Applicant: Lucasfilm Entertainment Company Ltd.
    Inventors: Andrew Grant, Lutz Markus Latta, Ian Wakelin, Darby Johnston, John Gaeta
  • Patent number: 9401025
    Abstract: A system includes a visual data collector for collecting visual information from an image of one or more features of an object. The system also includes a physical data collector for collecting sensor information provided by at one or more sensors attached to the object. The system also includes a computer system that includes a motion data combiner for combining the visual information the sensor information. The motion data combiner is configured to determine the position of a representation of one or more of the feature in a virtual representation of the object from the combined visual information and sensor information. Various types of virtual representations may be provided from the combined information, for example, one or more poses (e.g., position and orientation) of the object may be represented.
    Type: Grant
    Filed: September 21, 2015
    Date of Patent: July 26, 2016
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventors: Steve Sullivan, Kevin Wooley, Brett A. Allen, Michael Sanders
  • Publication number: 20160180501
    Abstract: Methods and systems efficiently apply known distortion, such as of a camera and lens, to source image data to produce data of an output image with the distortion. In an embodiment, an output image field is segmented into regions so that on each segment the distortion function is approximately linear, and segmentation data is stored in a quadtree. The distortion function is applied to the segmented image field to produce a segmented rendered distortion image (SRDI) and a corresponding look-up table. To distort a source image, a location in the output image field is selected, and the uniquely colored segment at the same location in the SRDI is found. The look-up table provides the local linear inverse of the distortion function, which is applied to determine from where in the source image to take image texture data for the distorted output image.
    Type: Application
    Filed: December 22, 2014
    Publication date: June 23, 2016
    Applicant: LUCASFILM ENTERTAINMENT COMPANY, LTD.
    Inventor: RONALD MALLET
  • Patent number: 9369694
    Abstract: A computer-implemented method for adjusting stereo images includes receiving a video sequence associated with a recorded setting of a stereoscopic camera, the video sequence comprising pairs of left and right images. The method includes processing the pairs of left and right images to reduce influence of a discrepancy between the recorded setting and an actual configuration of the stereoscopic camera.
    Type: Grant
    Filed: September 5, 2013
    Date of Patent: June 14, 2016
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventors: John M. Levin, Brian Cantwell, Ronald Mallet, Jeffrey Saltzman
  • Patent number: 9342912
    Abstract: The subject matter of this specification can be embodied in, among other things, a method that includes determining a transform of a portion of constituent components of a source shape. The transform includes one or more states for the portion of constituent components of the source shape. The method also includes accessing a mapping function that associates the one or more states with one or more controls for a target shape, where the one or more controls configured for access by a user for manipulating constituent components of the target shape. The method includes outputting a transform for the target shape based on the one or more controls associated with the transformed constituent components of the source shape.
    Type: Grant
    Filed: June 6, 2007
    Date of Patent: May 17, 2016
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventors: Frederic P. Pighin, Cary Phillips, Steve Sullivan
  • Patent number: 9335902
    Abstract: A first input is received in an animation creation application having a user interface showing a virtual-space area for first objects, and a timeline area for second objects representing events. To generate the first input, a user presses and holds an input control while a cursor is over one of the first or second objects. It is determined whether the input control is held for at least a predefined duration. If so, a copy of the object is assigned to the cursor, and the copy is subsequently pasted at another location in the user interface upon the input control ceasing to be held after the cursor is moved to the other location. If the input control does not remain held for at least the predefined duration the copy of the object is not assigned to the cursor.
    Type: Grant
    Filed: May 16, 2013
    Date of Patent: May 10, 2016
    Assignee: LUCASFILM ENTERTAINMENT COMPANY, LTD.
    Inventors: Joshua Goldenberg, Louise Rasmussen, Adam Schnitzer, Domenico Porcino, Lucas A. Kovar
  • Patent number: 9332285
    Abstract: Systems and techniques are provided for switching between different modes of a media content item. A media content item may include a movie that has different modes, such as a cinematic mode and an interactive mode. For example, a movie may be presented in a cinematic mode that does not allow certain user interactions with the movie. The movie may be switched to an interactive mode during any point of the movie, allowing a viewer to interact with various aspects of the movie. The movie may be displayed using different formats and resolutions depending on which mode the movie is being presented.
    Type: Grant
    Filed: May 28, 2015
    Date of Patent: May 3, 2016
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventors: Andrew Grant, Lutz Markus Latta, Ian Wakelin, Darby Johnston, John Gaeta
  • Patent number: 9324179
    Abstract: Among other aspects, on computer-implemented method includes: receiving at least one command in a computer system from a handheld device; positioning a virtual camera and controlling a virtual scene according to the command; and in response to the command, generating an output to the handheld device for displaying a view of the virtual scene as controlled on a display of the handheld device, the view captured by the virtual camera as positioned.
    Type: Grant
    Filed: January 12, 2015
    Date of Patent: April 26, 2016
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventors: Kevin Wooley, Michael Sanders, Steve Sullivan, Spencer Reynolds, Brian Cantwell
  • Patent number: 9317954
    Abstract: Techniques for facial performance capture using an adaptive model are provided herein. For example, a computer-implemented method may include obtaining a three-dimensional scan of a subject and a generating customized digital model including a set of blendshapes using the three-dimensional scan, each of one or more blendshapes of the set of blendshapes representing at least a portion of a characteristic of the subject. The method may further include receiving input data of the subject, the input data including video data and depth data, tracking body deformations of the subject by fitting the input data using one or more of the blendshapes of the set, and fitting a refined linear model onto the input data using one or more adaptive principal component analysis shapes.
    Type: Grant
    Filed: December 26, 2013
    Date of Patent: April 19, 2016
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventors: Hao Li, Jihun Yu, Yuting Ye, Christoph Bregler
  • Patent number: 9307231
    Abstract: An apparatus is disclosed which may serve as a target for calibrating a camera. The apparatus comprises one or more planar surfaces. The apparatus includes at least one fiducial marking on a planar surface. The set of all planar markings on the apparatus are distinguishable.
    Type: Grant
    Filed: April 8, 2014
    Date of Patent: April 5, 2016
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventors: Ronald Mallet, Jason Snell, Jeff Saltzman, Douglas Moore, Paige Warner
  • Patent number: 9307232
    Abstract: An apparatus is disclosed which may serve as a target for calibrating a camera. The apparatus includes a hollow body having an interior surface, an exterior surface and at least one window formed in the hollow body through which the interior surface is visible. A plurality of distinguishable fiducial markers are arranged in a predetermined pattern along the interior and exterior surface of the hollow body. The fiducial markers can be distinguishable such that, for any given image of the target captured by a camera, there is only one position, rotation, distortion value, and focal length for the camera of interest.
    Type: Grant
    Filed: September 30, 2014
    Date of Patent: April 5, 2016
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventor: Paige Warner
  • Publication number: 20160093112
    Abstract: A method may include receiving a plurality of objects from a 3-D virtual scene. The plurality of objects may be arranged in a hierarchy. The method may also include generating a plurality of identifiers for the plurality of objects. The plurality of identifiers may include a first identifier for a first object in the plurality of objects, and the identifier may be generated based on a position of the first object in the hierarchy. The method may additionally include performing a rendering operation on the plurality of objects to generate a deep image. The deep image may include a plurality of samples that correspond to the first object. The method may further include propagating the plurality of identifiers through the rendering operation such that each of the plurality of samples in the deep image that correspond to the first object are associated with the identifier.
    Type: Application
    Filed: September 30, 2014
    Publication date: March 31, 2016
    Applicant: LUCASFILM ENTERTAINMENT COMPANY, LTD.
    Inventors: SHIJUN HAW, XAVIER BERNASCONI
  • Patent number: 9300852
    Abstract: Among other disclosed subject matter, a system includes a first camera generating a live image of a scene, the first camera configured for being placed in a plurality of locations by robotic motion. The system includes a handheld device that includes a display device for continuously presenting the live image, wherein movement of the handheld device causes the handheld device to generate an output that controls the robotic motion.
    Type: Grant
    Filed: February 24, 2014
    Date of Patent: March 29, 2016
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventor: Domenico Porcino
  • Publication number: 20160078675
    Abstract: Methods are disclosed for the computer generation of data for images that include hair, fur, or other strand-like material. A volume for the hair is specified, having a plurality of surfaces. A fluid flow simulation is performed within the volume, with a first surface of the volume being a source area through which fluid is simulated to enter the volume, and a second surface being an exit surface through which fluid is simulated as exiting the volume. The fluid flow simulation may be used to produce fluid flow lines, such as from a velocity vector field for the fluid. Fluid flow lines are selected, and image data of hairs that follow the fluid flow lines are generated. Other embodiments include generating animation sequences by generating images wherein the volume and surfaces vary between frames.
    Type: Application
    Filed: September 16, 2014
    Publication date: March 17, 2016
    Applicant: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventors: Stephen D. Bowline, Nicholas Grant Rasmussen
  • Patent number: 9280034
    Abstract: A movie set can include light sources each producing a light corresponding to a light channel, at least one high-frame rate camera, and a controller connected to the light sources and camera to synchronize the camera and light sources. The number of light channels can be proportional to the frame rate. For example, if the filming frame rate is 120 frames per second (fps) and the playback frame rate is 24 fps, then 5 light channels can be used. In this example, for every one playback frame, 5 frames were filmed by the high frame rate camera. The controller modulates the light channels such that each of the 5 frames has different lighting characteristics. In post-production, contributions from each of the light channels can be included or excluded from the final frame. An optical flow algorithm can be used to stitch together frames with different dynamic light characteristics.
    Type: Grant
    Filed: September 5, 2013
    Date of Patent: March 8, 2016
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventors: Kimberley Sean Libreri, Curt Isamu Miyashiro
  • Patent number: 9275490
    Abstract: A method of applying a post-render motion blur to an object may include receiving a first image of the object. The first image need not be motion blurred, and the first image may include a first pixel and rendered color information for the first pixel. The method may also include receiving a second image of the object. The second image may be motion blurred, and the second image may include a second pixel and a location of the second pixel before the second image was motion blurred. Areas that are occluded in the second image may be identified and colored using a third image rendering only those areas. Unoccluded areas of the second image may be colored using information from the first image.
    Type: Grant
    Filed: May 4, 2015
    Date of Patent: March 1, 2016
    Assignee: Lucasfilm Entertainment Company Ltd.
    Inventors: Victor Schutz, Patrick Conran
  • Patent number: 9256778
    Abstract: In one aspect, a computer implemented method of motion capture, the method includes tracking the motion of a dynamic object bearing a pattern configured such that a first portion of the patterns is tracked at a first resolution and a second portion of the pattern is tracked at a second resolution. The method further includes causing data representing the motion to be stored to a computer readable medium.
    Type: Grant
    Filed: December 15, 2014
    Date of Patent: February 9, 2016
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventors: Kevin Wooley, Ronald Mallet
  • Patent number: 9256973
    Abstract: A system includes a computer system capable of representing one or more animated characters. The computer system includes a blendshape manager that combines multiple blendshapes to produce the animated character. The computer system also includes an expression manager to respectively adjust one or more control parameters associated with each of the plurality of blendshapes for adjusting an expression of the animated character. The computer system also includes a corrective element manager that applies one or more corrective elements to the combined blendshapes based upon at least one of the control parameters. The one or more applied corrective elements are adjustable based upon one or more of the control parameters absent the introduction of one or more additional control parameters.
    Type: Grant
    Filed: December 23, 2013
    Date of Patent: February 9, 2016
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventors: Michael Koperwas, Frederic P. Pighin, Cary Phillips, Steve Sullivan, Eduardo Hueso
  • Publication number: 20160012598
    Abstract: A system includes a visual data collector for collecting visual information from an image of one or more features of an object. The system also includes a physical data collector for collecting sensor information provided by at one or more sensors attached to the object. The system also includes a computer system that includes a motion data combiner for combining the visual information the sensor information. The motion data combiner is configured to determine the position of a representation of one or more of the feature in a virtual representation of the object from the combined visual information and sensor information. Various types of virtual representations may be provided from the combined information, for example, one or more poses (e.g., position and orientation) of the object may be represented.
    Type: Application
    Filed: September 21, 2015
    Publication date: January 14, 2016
    Applicant: LUCASFILM ENTERTAINMENT COMPANY, LTD.
    Inventors: STEVE SULLIVAN, KEVIN WOOLEY, BRETT A. ALLEN, MICHAEL SANDERS
  • Patent number: 9223488
    Abstract: A system includes a computing device that includes a memory configured to store instructions. The computing device also includes a processor configured to execute the instructions to perform a method that includes defining a first portion of a display as a workspace for a graphical representation of a portion of a network of processing operations. The workspace provides a navigable view of the graphical representation for editing the displayed portion of the network. The method also includes defining at least a second portion of the display, different from first portion, for a compressed view of a portion of the network of processing operations external to the first portion of the display. The method also includes simultaneously presenting the first portion and the second portion on the display.
    Type: Grant
    Filed: May 26, 2011
    Date of Patent: December 29, 2015
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventor: Dave Lajoie
  • Publication number: 20150348326
    Abstract: A method may include displaying, on one or more display devices in a virtual-reality environment, a visual representation of a 3-D virtual scene from the perspective of a subject location in the virtual-reality environment. The method may also include displaying, on the one or more display devices, a chroma-key background with the visual representation. The method may further include recording, using a camera, an image of the subject in the virtual-reality environment against the chroma-key background.
    Type: Application
    Filed: September 11, 2014
    Publication date: December 3, 2015
    Applicant: Lucasfilm Entertainment Co. Ltd.
    Inventors: Mike Sanders, Kim Libreri, Nick Rasmussen, John Gaeta
  • Publication number: 20150350628
    Abstract: A method may include presenting a scene from linear content on one or more display devices in an immersive environment, and receiving, from a user within the immersive environment, input to change an aspect of the scene. The method may also include accessing 3-D virtual scene information previously used to render the scene, and changing the 3-D virtual scene information according to the changed aspect of the scene. The method may additionally include rending the 3-D virtual scene to incorporate the changed aspect, and presenting the rendered scene in real time in the immersive user environment.
    Type: Application
    Filed: December 15, 2014
    Publication date: December 3, 2015
    Applicant: Lucasfilm Entertainment Co. Ltd.
    Inventors: Mike Sanders, Kim Libreri, Nick Rasmussen, John Gaeta
  • Patent number: 9196074
    Abstract: A system includes a computing device that includes a memory configured to store instructions. The computing device also includes a processor configured to execute the instructions to perform a method that includes producing an animation model from one or more representations of an object provided from a deformable likeness of the object. The one or more representations are based upon position information from a collection of images of the object captured by at least one camera. The method also includes refining the animation model to produce representations that substantially match the one or more representations provided by the deformable likeness of the object. Refining the animation model is based upon the position information from the collection of images of the object and one or more constraints.
    Type: Grant
    Filed: June 24, 2011
    Date of Patent: November 24, 2015
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventors: Kiran S. Bhat, Delio Tramontozzi, Tim Harrington
  • Patent number: 9183660
    Abstract: A system includes a computing device that includes a memory for storing instructions. The computing device also includes a processor configured to execute the instructions to perform a method that includes combining, in a nonlinear manner, a first set of vertex displacements that represent the difference between a first animated expression and a neutral animated expression with a second set of vertex displacements that represent the difference between a second animated expression and the neutral animated expression. The number of vertices associated with the first set of vertex displacements of the first animated expression is equivalent to the number of vertices associated with the second set of vertex displacements of the second animated expression.
    Type: Grant
    Filed: November 26, 2013
    Date of Patent: November 10, 2015
    Assignee: Lucasfilm Entertainment Company Ltd.
    Inventors: Michael Koperwas, Frederic P. Pighin
  • Publication number: 20150317765
    Abstract: A method of compressing a deep image representation may include receiving a deep image, where the deep image may include multiple pixels, and where each pixel in the deep image may include multiple samples. The method may also include compressing the deep image by combining samples in each pixel that are associated with the same primitives. This process may be repeated on a pixel-by-pixel basis. Some embodiments may use primitive IDs to match pixels to primitives through the rendering and compositing process.
    Type: Application
    Filed: April 30, 2014
    Publication date: November 5, 2015
    Applicant: Lucasfilm Entertainment Company, Ltd.
    Inventor: Shijun Haw
  • Patent number: 9177408
    Abstract: A computer-implemented method for handling a modification of an animation having a constraint includes detecting a user modification of an animation that involves at least first and second objects, the first object constrained to the second object during a constrained period and non-constrained to the second object during a non-constrained period. The method includes, based on the user modification, selecting one of at least first and second compensation adjustments for the animation based on a compensation policy; and adjusting the animation according to the selected compensation adjustment.
    Type: Grant
    Filed: June 15, 2011
    Date of Patent: November 3, 2015
    Assignee: Lucasfilm Entertainment Company Ltd.
    Inventors: Greg James, John Horn, Laurie Berliner, Adam Schnitzer, Max S-Han Chen
  • Publication number: 20150294492
    Abstract: A method of generating unrecorded camera views may include receiving a plurality of 2-D video sequences of a subject in a real 3-D space, where each 2-D video sequence may depict the subject from a different perspective. The method may also include generating a 3-D representation of the subject in a virtual 3-D space, where a geometry and texture of the 3-D representation may be generated based on the 2D video sequences, and the motion of the 3-D representation in the virtual 3-D space is based on motion of the subject in the real 3-D space. The method may additionally include generating a 2-D video sequence of the motion of the 3D representation using a virtual camera in the virtual 3-D space where the perspective of the virtual camera may be different than the perspectives of the plurality of 2-D video sequences.
    Type: Application
    Filed: August 25, 2014
    Publication date: October 15, 2015
    Applicant: Lucasfilm Entertainment Co., Ltd.
    Inventors: Hilmar Koch, Ronald Mallet, Kim Libreri, Paige Warner, Mike Sanders, John Gaeta
  • Publication number: 20150288951
    Abstract: Methods and systems are disclosed for calibrating a camera using a calibration target apparatus that contains at least one fiducial marking on a planar surface. The set of all planar markings on the apparatus are distinguishable. Parameters of the camera are inferred from at least one image of the calibration target apparatus. In some embodiments, pixel coordinates of identified fiducial markings in an image are used with geometric knowledge of the apparatus to calculate camera parameters.
    Type: Application
    Filed: April 8, 2014
    Publication date: October 8, 2015
    Applicant: LUCASFILM ENTERTAINMENT COMPANY, LTD.
    Inventors: RONALD MALLET, JASON SNELL, JEFF SALTZMAN, DOUGLAS MOORE, PAIGE WARNER
  • Publication number: 20150288956
    Abstract: An apparatus is disclosed which may serve as a target for calibrating a camera. The apparatus comprises one or more planar surfaces. The apparatus includes at least one fiducial marking on a planar surface. The set of all planar markings on the apparatus are distinguishable.
    Type: Application
    Filed: April 8, 2014
    Publication date: October 8, 2015
    Applicant: LUCASFILM ENTERTAINMENT COMPANY, LTD.
    Inventors: RONALD MALLET, JASON SNELL, JEFF SALTZMAN, DOUGLAS MOORE, PAIGE WARNER
  • Patent number: D751627
    Type: Grant
    Filed: September 30, 2014
    Date of Patent: March 15, 2016
    Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
    Inventor: Paige Warner