Patents by Inventor Xiaohuan C. Wang

Xiaohuan C. Wang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10909657
    Abstract: Artistic styles extracted from one or more source images may be applied to one or more target images, e.g., in the form of stylized images and/or stylized video sequences. The extracted artistic style may be stored as a plurality of layers in a neural network, which neural network may be further optimized, e.g., via the fusion of various elements of the network's architectures. An optimized network architecture may be determined for each processing environment in which the network will be applied. The artistic style may be applied to the obtained images and/or video sequence of images using various optimization methods, such as the use of scalars to control the resolution of the unstylized and stylized images, temporal consistency constraints, as well as the use of dynamically adjustable or selectable versions of Deep Neural Networks (DNN) that are responsive to system performance parameters, such as available processing resources and thermal capacity.
    Type: Grant
    Filed: July 11, 2018
    Date of Patent: February 2, 2021
    Assignee: APPLE INC.
    Inventors: Francesco Rossi, Xiaohuan C. Wang, Brian E. Walsh, Bartlomiej W. Rymkowski, Xiaojin Shi, Marco Zuliani, Alexey Marinichev, Benjamin Poulain, Omid Khalili
  • Patent number: 10664963
    Abstract: Artistic styles extracted from one or more source images may be applied to one or more target images, e.g., in the form of stylized images and/or stylized video sequences. The extracted artistic style may be stored as a plurality of layers in a neural network, which neural network may be further optimized, e.g., via the fusion of various elements of the network's architectures. An optimized network architecture may be determined for each processing environment in which the network will be applied. The artistic style may be applied to the obtained images and/or video sequence of images using various optimization methods, such as the use of scalars to control the resolution of the unstylized and stylized images, temporal consistency constraints, as well as the use of dynamically adjustable or selectable versions of Deep Neural Networks (DNN) that are responsive to system performance parameters, such as available processing resources and thermal capacity.
    Type: Grant
    Filed: July 11, 2018
    Date of Patent: May 26, 2020
    Assignee: Apple Inc.
    Inventors: Francesco Rossi, Xiaohuan C. Wang, Bartlomiej W. Rymkowski, Xiaojin Shi, Marco Zuliani, Alexey Marinichev
  • Patent number: 9997196
    Abstract: A novel method for retiming a portion of a media content (e.g., audio data, video data, audio and video data, etc.) in a media-editing application is provided. The media editing application includes a user interface for defining a range in order to select a portion of the media content. The media editing application performs retiming by applying a speed effect to the portion of the media content selected by the defined range. For a faster speed effect, the media editing application retimes the selected portion of the media content by sampling the media content at a faster rate. For a slower speed effect, the media editing application retimes the selected portion of the media content by sampling the content at a slower rate.
    Type: Grant
    Filed: May 17, 2011
    Date of Patent: June 12, 2018
    Assignee: APPLE INC.
    Inventors: Xiaohuan C. Wang, Giovanni Agnoli, David N. Chen, Vijay Sundaram, Brian Meaney, Mike Stern, Paul T. Schneider, Eric J. Graves, Randy Ubillos
  • Patent number: 9412414
    Abstract: Some embodiments provide a method that receives the addition of a video clip having a first set of spatial properties to a composite video project having a second set of spatial properties. When the first set of spatial properties and the second set of spatial properties are different, the method automatically applies a spatial conform effect to the video clip to conform images of the video clip to the second set of spatial properties. The method receives input to transform images of the video clip as displayed in the composite video project. The method stores the spatial conform effect and the received transform as separate effects for the video clip.
    Type: Grant
    Filed: September 7, 2011
    Date of Patent: August 9, 2016
    Assignee: APPLE INC.
    Inventors: Xiaohuan C. Wang, Giovanni Agnoli, Shaun M. Poole, Colleen Pendergast, Randy Ubillos, Vijay Sundaram, Paul T. Schneider, Peter Chou
  • Patent number: 9014544
    Abstract: A novel method for creating multimedia presentations in a media editing application is provided. The method selects a portion of a media clip and retimes the selected portion of the media clip from a first playback speed to a second playback speed. The method defines a transition interval for a discontinuity between a first section of the media clip with the first playback speed and a second section of the media clip with the second playback speed. The media clip is played back according to a smoothed curve that is constrained by the transition interval, the first playback speed, and the second playback speed. The smoothed curve transitions gradually from the first playback speed at the start of the transition interval to the second playback speed at the end of the transition interval.
    Type: Grant
    Filed: December 19, 2012
    Date of Patent: April 21, 2015
    Assignee: Apple Inc.
    Inventors: Xiaohuan C. Wang, Brian Meaney, Michael P. Stern, Vijay Sundaram
  • Patent number: 8839110
    Abstract: Some embodiments provide a method that receives the addition of a video clip to a composite video project. The video clip has a sequence of video images at a first frame rate and the composite video project has a second frame rate for outputting video images. When the first frame rate does not match the second frame rate but is within a threshold of the second frame rate, the method generates output video images for a particular duration of the composite video project at the second frame rate by using each of the video images of the video clip once during the particular duration. When the first frame rate is not within the threshold, generating output video images for the particular duration of the composite video project at the second frame rate by using at least one of the video images for each output video image over the particular duration.
    Type: Grant
    Filed: August 25, 2011
    Date of Patent: September 16, 2014
    Assignee: Apple Inc.
    Inventors: Xiaohuan C. Wang, Giovanni Agnoli, Shaun M. Poole, Vijay Sundaram, Eric J. Graves, Peter Chou, Colleen Pendergast, David N. Chen
  • Publication number: 20140169765
    Abstract: A novel method for creating multimedia presentations in a media editing application is provided. The method selects a portion of a media clip and retimes the selected portion of the media clip from a first playback speed to a second playback speed. The method defines a transition interval for a discontinuity between a first section of the media clip with the first playback speed and a second section of the media clip with the second playback speed. The media clip is played back according to a smoothed curve that is constrained by the transition interval, the first playback speed, and the second playback speed. The smoothed curve transitions gradually from the first playback speed at the start of the transition interval to the second playback speed at the end of the transition interval.
    Type: Application
    Filed: December 19, 2012
    Publication date: June 19, 2014
    Applicant: APPLE INC.
    Inventors: Xiaohuan C. Wang, Brian Meaney, Michael P. Stern, Vijay Sundaram
  • Publication number: 20120210232
    Abstract: Some embodiments provide a method that receives the addition of a video clip to a composite video project. The video clip has a sequence of video images at a first frame rate and the composite video project has a second frame rate for outputting video images. When the first frame rate does not match the second frame rate but is within a threshold of the second frame rate, the method generates output video images for a particular duration of the composite video project at the second frame rate by using each of the video images of the video clip once during the particular duration. When the first frame rate is not within the threshold, generating output video images for the particular duration of the composite video project at the second frame rate by using at least one of the video images for each output video image over the particular duration.
    Type: Application
    Filed: August 25, 2011
    Publication date: August 16, 2012
    Inventors: Xiaohuan C. Wang, Giovanni Agnoli, Shaun M. Poole, Vijay Sundaram, Eric J. Graves, Peter Chou, Colleen Pendergast, David N. Chen
  • Publication number: 20120207452
    Abstract: Some embodiments provide a method that receives the addition of a video clip having a first set of spatial properties to a composite video project having a second set of spatial properties. When the first set of spatial properties and the second set of spatial properties are different, the method automatically applies a spatial conform effect to the video clip to conform images of the video clip to the second set of spatial properties. The method receives input to transform images of the video clip as displayed in the composite video project. The method stores the spatial conform effect and the received transform as separate effects for the video clip.
    Type: Application
    Filed: September 7, 2011
    Publication date: August 16, 2012
    Inventors: Xiaohuan C. Wang, Giovanni Agnoli, Shaun M. Poole, Colleen Pendergast, Randy Ubillos, Vijay Sundaram, Paul T. Schneider, Peter Chou
  • Publication number: 20120210228
    Abstract: A novel method for retiming a portion of a media content (e.g., audio data, video data, audio and video data, etc.) in a media-editing application is provided. The media editing application includes a user interface for defining a range in order to select a portion of the media content. The media editing application performs retiming by applying a speed effect to the portion of the media content selected by the defined range. For a faster speed effect, the media editing application retimes the selected portion of the media content by sampling the media content at a faster rate. For a slower speed effect, the media editing application retimes the selected portion of the media content by sampling the content at a slower rate.
    Type: Application
    Filed: May 17, 2011
    Publication date: August 16, 2012
    Inventors: Xiaohuan C. Wang, Giovanni Agnoli, David N. Chen, Vijay Sundaram, Brian Meaney, Mike Stern, Paul T. Schneider, Eric J. Graves, Randy Ubillos