Patents by Inventor Jianlong Fu
Jianlong Fu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240153189Abstract: According to implementations of the subject matter described herein, there is provided a solution for generating a video from an image. In this solution, an input image and a reference video are obtained; a motion pattern of a reference object in the reference video is determined based on the reference video. An output video with the input image as a starting frame is generated. Motion of a target object in the output video has the motion pattern of the reference object and the target object is in the input image. In this way, according to the solution, the motion pattern of the reference object in the reference video can be intuitively applied to the input image to generate the output video, and the motion of the target object in the output video has the motion pattern of the reference object.Type: ApplicationFiled: April 2, 2022Publication date: May 9, 2024Inventors: Bei Liu, Huan Yang, Jianlong Fu
-
Patent number: 11935154Abstract: A method and system for transforming an input image via a plurality of image transformation stylizers includes receiving the input image; providing the input image, information about the plurality of image transformation stylizers and at least one of user data, history data, and contextual data to a trained machine-learning (ML) model for selecting a subset of the plurality of image transformation stylizers; receiving as an output from the ML model the subset of image transformation stylizers; executing the subset of the image transformation stylizers on the input image to generate a plurality of transformed output images; ranking the plurality of transformed output images based on at least one of the input image, the user data, the history data, and the contextual data; and providing the ranked plurality of transformed output images for display.Type: GrantFiled: March 2, 2022Date of Patent: March 19, 2024Assignee: Microsoft Technology Licensing, LLCInventors: Ji Li, Fatima Zohra Daha, Bei Liu, Huan Yang, Jianlong Fu
-
Patent number: 11914841Abstract: In embodiments of the present disclosure, there is provided a method for generating a stylized icon automatically. After a query text inputted by a user is obtained, a trained generator is used to generate a structured icon that can characterize a structure of an object, and then the structured icon is stylized, such as performing color padding or adding other styles, so as to generate a high-quality stylized icon for the user. In embodiments of the present disclosure, a structured icon and a stylized icon are generated respectively at two stages, where the structured icon can clearly characterize the structure of the object, while the stylized icon can be richer in color and style. Therefore, the stylized icon generated according to embodiments of the present disclosure has a higher quality and is more realistic, thereby improving the user experience of icon generation.Type: GrantFiled: March 19, 2020Date of Patent: February 27, 2024Assignee: Microsoft Technology Licensing, LLCInventors: Jianlong Fu, Jinpeng Wang, Chin-Yew Lin
-
Patent number: 11810267Abstract: A system and method for rich content transformation are provided. The system and method allow rich content transformation to be separately processed on a client device and on a cloud-based server. The client device downsizes a rich content and transmits the downsized rich content to the cloud-based server via a network. The cloud-based server calculates function parameters based on the downsized rich content using one or more machine learning models included in the server. The calculated function parameters are transmitted to the client device via the network. The client device then applies these function parameters to the rich content on the client device to obtain the transformed rich content.Type: GrantFiled: April 26, 2021Date of Patent: November 7, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Ji Li, Huan Yang, Jianlong Fu
-
Publication number: 20230351752Abstract: Various implementations of the subject matter relate to moment localization in media stream. In some implementations, a two-dimensional temporal feature map representing a plurality of moments within a media stream is extracted from the media stream, wherein the two-dimensional temporal feature map comprises a first dimension representing a start of a respective one of the plurality of moments and a second dimension representing an end of a respective one of the plurality of moments. A correlation between the plurality of moments and an action in the media stream is determined based on the two-dimensional temporal feature map.Type: ApplicationFiled: October 19, 2020Publication date: November 2, 2023Inventors: Houwen Peng, Jianlong Fu
-
Publication number: 20230281884Abstract: A method and system for transforming an input image via a plurality of image transformation stylizers includes receiving the input image; providing the input image, information about the plurality of image transformation stylizers and at least one of user data, history data, and contextual data to a trained machine-learning (ML) model for selecting a subset of the plurality of image transformation stylizers; receiving as an output from the ML model the subset of image transformation stylizers; executing the subset of the image transformation stylizers on the input image to generate a plurality of transformed output images; ranking the plurality of transformed output images based on at least one of the input image, the user data, the history data, and the contextual data; and providing the ranked plurality of transformed output images for display.Type: ApplicationFiled: March 2, 2022Publication date: September 7, 2023Applicant: Microsoft Technology Licensing, LLCInventors: Ji LI, Fatima Zohra DAHA, Bei LIU, Huan YANG, Jianlong FU
-
Publication number: 20230177643Abstract: There is provided a solution for image processing. In this solution, first and second information is determined based on texture features of an input image and a reference image. The first information at least indicates for a first pixel block in the input image a second pixel block in the reference image most relevant to the first pixel block in terms of the texture features, and the second information at least indicates a relevance of the first pixel block to the second pixel block. A transferred feature map with a target resolution is determined based on the first information and the reference image. The input image is transformed into an output image with the target resolution based on the transferred feature map and the second information. The output image reflects a texture feature of the reference image.Type: ApplicationFiled: April 20, 2021Publication date: June 8, 2023Inventors: Huan Yang, Jianlong FU, Baining GUO
-
Patent number: 11670071Abstract: In accordance with implementations of the subject matter described herein, a solution for fine-grained image recognition is proposed. This solution includes extracting a global feature of an image using a first sub-network of a first learning network; determining a first attention region of the image based on the global feature using a second sub-network of the first learning network, the first attention region including a discriminative portion of an object in the image; extracting a first local feature of the first attention region using a first sub-network of a second learning network; and determining a category of the object in the image based at least in part on the first local feature. Through this solution, it is possible to localize an image region at a finer scale accurately such that a local feature at a fine scale can be obtained for object recognition.Type: GrantFiled: May 29, 2018Date of Patent: June 6, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Jianlong Fu, Tao Mei
-
Publication number: 20220343461Abstract: A system and method for rich content transformation are provided. The system and method allow rich content transformation to be separately processed on a client device and on a cloud-based server. The client device downsizes a rich content and transmits the downsized rich content to the cloud-based server via a network. The cloud-based server calculates function parameters based on the downsized rich content using one or more machine learning models included in the server. The calculated function parameters are transmitted to the client device via the network. The client device then applies these function parameters to the rich content on the client device to obtain the transformed rich content.Type: ApplicationFiled: April 26, 2021Publication date: October 27, 2022Applicant: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Ji LI, Huan YANG, Jianlong FU
-
Publication number: 20220253202Abstract: In embodiments of the present disclosure, there is provided a method for generating a stylized icon automatically. After a query text inputted by a user is obtained, a trained generator is used to generate a structured icon that can characterize a structure of an object, and then the structured icon is stylized, such as performing color padding or adding other styles, so as to generate a high-quality stylized icon for the user. In embodiments of the present disclosure, a structured icon and a stylized icon are generated respectively at two stages, where the structured icon can clearly characterize the structure of the object, while the stylized icon can be richer in color and style. Therefore, the stylized icon generated according to embodiments of the present disclosure has a higher quality and is more realistic, thereby improving the user experience of icon generation.Type: ApplicationFiled: March 19, 2020Publication date: August 11, 2022Inventors: Jianlong Fu, Jinpeng Wang, Chin-Yew Lin
-
Publication number: 20200160124Abstract: In accordance with implementations of the subject matter described herein, a solution for fine-grained image recognition is proposed. This solution includes extracting a global feature of an image using a first sub-network of a first learning network; determining a first attention region of the image based on the global feature using a second sub-network of the first learning network, the first attention region including a discriminative portion of an object in the image; extracting a first local feature of the first attention region using a first sub-network of a second learning network; and determining a category of the object in the image based at least in part on the first local feature. Through this solution, it is possible to localize an image region at a finer scale accurately such that a local feature at a fine scale can be obtained for object recognition.Type: ApplicationFiled: May 29, 2018Publication date: May 21, 2020Applicant: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Jianlong FU, Tao MEI
-
Patent number: 9754188Abstract: Techniques and constructs to facilitate automatic tagging can provide improvements in image storage and searching. The constructs may enable training a deep network using tagged source images and target images. The constructs may also train a top layer of the deep network using a personal photo ontology. The constructs also may select one or more concepts from the ontology for tagging personal digital images.Type: GrantFiled: October 23, 2014Date of Patent: September 5, 2017Assignee: Microsoft Technology Licensing, LLCInventors: Tao Mei, Jianlong Fu, Kuiyuan Yang, Yong Rui
-
Publication number: 20160117574Abstract: Techniques and constructs to facilitate automatic tagging can provide improvements in image storage and searching. The constructs may enable training a deep network using tagged source images and target images. The constructs may also train a top layer of the deep network using a personal photo ontology. The constructs also may select one or more concepts from the ontology for tagging personal digital images.Type: ApplicationFiled: October 23, 2014Publication date: April 28, 2016Inventors: Tao Mei, Jianlong Fu, Kuiyuan Yang, Yong Rui
-
Patent number: D895899Type: GrantFiled: April 16, 2020Date of Patent: September 8, 2020Inventor: Jianlong Fu
-
Patent number: D933299Type: GrantFiled: September 27, 2020Date of Patent: October 12, 2021Inventor: Jianlong Fu
-
Patent number: D997456Type: GrantFiled: January 17, 2022Date of Patent: August 29, 2023Inventor: Jianlong Fu