Patents by Inventor Xiaohuan C. Wang
Xiaohuan C. Wang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 10909657Abstract: Artistic styles extracted from one or more source images may be applied to one or more target images, e.g., in the form of stylized images and/or stylized video sequences. The extracted artistic style may be stored as a plurality of layers in a neural network, which neural network may be further optimized, e.g., via the fusion of various elements of the network's architectures. An optimized network architecture may be determined for each processing environment in which the network will be applied. The artistic style may be applied to the obtained images and/or video sequence of images using various optimization methods, such as the use of scalars to control the resolution of the unstylized and stylized images, temporal consistency constraints, as well as the use of dynamically adjustable or selectable versions of Deep Neural Networks (DNN) that are responsive to system performance parameters, such as available processing resources and thermal capacity.Type: GrantFiled: July 11, 2018Date of Patent: February 2, 2021Assignee: APPLE INC.Inventors: Francesco Rossi, Xiaohuan C. Wang, Brian E. Walsh, Bartlomiej W. Rymkowski, Xiaojin Shi, Marco Zuliani, Alexey Marinichev, Benjamin Poulain, Omid Khalili
-
Patent number: 10664963Abstract: Artistic styles extracted from one or more source images may be applied to one or more target images, e.g., in the form of stylized images and/or stylized video sequences. The extracted artistic style may be stored as a plurality of layers in a neural network, which neural network may be further optimized, e.g., via the fusion of various elements of the network's architectures. An optimized network architecture may be determined for each processing environment in which the network will be applied. The artistic style may be applied to the obtained images and/or video sequence of images using various optimization methods, such as the use of scalars to control the resolution of the unstylized and stylized images, temporal consistency constraints, as well as the use of dynamically adjustable or selectable versions of Deep Neural Networks (DNN) that are responsive to system performance parameters, such as available processing resources and thermal capacity.Type: GrantFiled: July 11, 2018Date of Patent: May 26, 2020Assignee: Apple Inc.Inventors: Francesco Rossi, Xiaohuan C. Wang, Bartlomiej W. Rymkowski, Xiaojin Shi, Marco Zuliani, Alexey Marinichev
-
Patent number: 9997196Abstract: A novel method for retiming a portion of a media content (e.g., audio data, video data, audio and video data, etc.) in a media-editing application is provided. The media editing application includes a user interface for defining a range in order to select a portion of the media content. The media editing application performs retiming by applying a speed effect to the portion of the media content selected by the defined range. For a faster speed effect, the media editing application retimes the selected portion of the media content by sampling the media content at a faster rate. For a slower speed effect, the media editing application retimes the selected portion of the media content by sampling the content at a slower rate.Type: GrantFiled: May 17, 2011Date of Patent: June 12, 2018Assignee: APPLE INC.Inventors: Xiaohuan C. Wang, Giovanni Agnoli, David N. Chen, Vijay Sundaram, Brian Meaney, Mike Stern, Paul T. Schneider, Eric J. Graves, Randy Ubillos
-
Patent number: 9412414Abstract: Some embodiments provide a method that receives the addition of a video clip having a first set of spatial properties to a composite video project having a second set of spatial properties. When the first set of spatial properties and the second set of spatial properties are different, the method automatically applies a spatial conform effect to the video clip to conform images of the video clip to the second set of spatial properties. The method receives input to transform images of the video clip as displayed in the composite video project. The method stores the spatial conform effect and the received transform as separate effects for the video clip.Type: GrantFiled: September 7, 2011Date of Patent: August 9, 2016Assignee: APPLE INC.Inventors: Xiaohuan C. Wang, Giovanni Agnoli, Shaun M. Poole, Colleen Pendergast, Randy Ubillos, Vijay Sundaram, Paul T. Schneider, Peter Chou
-
Patent number: 9014544Abstract: A novel method for creating multimedia presentations in a media editing application is provided. The method selects a portion of a media clip and retimes the selected portion of the media clip from a first playback speed to a second playback speed. The method defines a transition interval for a discontinuity between a first section of the media clip with the first playback speed and a second section of the media clip with the second playback speed. The media clip is played back according to a smoothed curve that is constrained by the transition interval, the first playback speed, and the second playback speed. The smoothed curve transitions gradually from the first playback speed at the start of the transition interval to the second playback speed at the end of the transition interval.Type: GrantFiled: December 19, 2012Date of Patent: April 21, 2015Assignee: Apple Inc.Inventors: Xiaohuan C. Wang, Brian Meaney, Michael P. Stern, Vijay Sundaram
-
Patent number: 8839110Abstract: Some embodiments provide a method that receives the addition of a video clip to a composite video project. The video clip has a sequence of video images at a first frame rate and the composite video project has a second frame rate for outputting video images. When the first frame rate does not match the second frame rate but is within a threshold of the second frame rate, the method generates output video images for a particular duration of the composite video project at the second frame rate by using each of the video images of the video clip once during the particular duration. When the first frame rate is not within the threshold, generating output video images for the particular duration of the composite video project at the second frame rate by using at least one of the video images for each output video image over the particular duration.Type: GrantFiled: August 25, 2011Date of Patent: September 16, 2014Assignee: Apple Inc.Inventors: Xiaohuan C. Wang, Giovanni Agnoli, Shaun M. Poole, Vijay Sundaram, Eric J. Graves, Peter Chou, Colleen Pendergast, David N. Chen
-
Publication number: 20140169765Abstract: A novel method for creating multimedia presentations in a media editing application is provided. The method selects a portion of a media clip and retimes the selected portion of the media clip from a first playback speed to a second playback speed. The method defines a transition interval for a discontinuity between a first section of the media clip with the first playback speed and a second section of the media clip with the second playback speed. The media clip is played back according to a smoothed curve that is constrained by the transition interval, the first playback speed, and the second playback speed. The smoothed curve transitions gradually from the first playback speed at the start of the transition interval to the second playback speed at the end of the transition interval.Type: ApplicationFiled: December 19, 2012Publication date: June 19, 2014Applicant: APPLE INC.Inventors: Xiaohuan C. Wang, Brian Meaney, Michael P. Stern, Vijay Sundaram
-
Publication number: 20120210232Abstract: Some embodiments provide a method that receives the addition of a video clip to a composite video project. The video clip has a sequence of video images at a first frame rate and the composite video project has a second frame rate for outputting video images. When the first frame rate does not match the second frame rate but is within a threshold of the second frame rate, the method generates output video images for a particular duration of the composite video project at the second frame rate by using each of the video images of the video clip once during the particular duration. When the first frame rate is not within the threshold, generating output video images for the particular duration of the composite video project at the second frame rate by using at least one of the video images for each output video image over the particular duration.Type: ApplicationFiled: August 25, 2011Publication date: August 16, 2012Inventors: Xiaohuan C. Wang, Giovanni Agnoli, Shaun M. Poole, Vijay Sundaram, Eric J. Graves, Peter Chou, Colleen Pendergast, David N. Chen
-
Publication number: 20120207452Abstract: Some embodiments provide a method that receives the addition of a video clip having a first set of spatial properties to a composite video project having a second set of spatial properties. When the first set of spatial properties and the second set of spatial properties are different, the method automatically applies a spatial conform effect to the video clip to conform images of the video clip to the second set of spatial properties. The method receives input to transform images of the video clip as displayed in the composite video project. The method stores the spatial conform effect and the received transform as separate effects for the video clip.Type: ApplicationFiled: September 7, 2011Publication date: August 16, 2012Inventors: Xiaohuan C. Wang, Giovanni Agnoli, Shaun M. Poole, Colleen Pendergast, Randy Ubillos, Vijay Sundaram, Paul T. Schneider, Peter Chou
-
Publication number: 20120210228Abstract: A novel method for retiming a portion of a media content (e.g., audio data, video data, audio and video data, etc.) in a media-editing application is provided. The media editing application includes a user interface for defining a range in order to select a portion of the media content. The media editing application performs retiming by applying a speed effect to the portion of the media content selected by the defined range. For a faster speed effect, the media editing application retimes the selected portion of the media content by sampling the media content at a faster rate. For a slower speed effect, the media editing application retimes the selected portion of the media content by sampling the content at a slower rate.Type: ApplicationFiled: May 17, 2011Publication date: August 16, 2012Inventors: Xiaohuan C. Wang, Giovanni Agnoli, David N. Chen, Vijay Sundaram, Brian Meaney, Mike Stern, Paul T. Schneider, Eric J. Graves, Randy Ubillos