Patents by Inventor Yale Song
Yale Song has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240046332Abstract: The present disclosure provides method and apparatus for determining a food item from a photograph and a corresponding restaurant serving the food item. An image is received from a user, the image being associated with a consumable item. One or more ingredients of the consumable item in the image is identified along with a location of the user and using a neural network, determining one or more similar images from a database. A restaurant associated with each of the one or more similar images is determined along with a similarity score indicating a similarity between the restaurant and the identified content of the image. The one or more restaurants and/or associated similar food items are ranked based on the similarity score and a list of ranked restaurants is provided to the user.Type: ApplicationFiled: October 20, 2023Publication date: February 8, 2024Inventors: Julia X. Gong, Jyotkumar Patel, Yale Song, Xuetao Yin, Xiujia Guo, Rajiv S. Binwade, Houdong Hu
-
Patent number: 11830056Abstract: The present disclosure provides method and apparatus for determining a food item from a photograph and a corresponding restaurant serving the food item. An image is received from a user, the image being associated with a consumable item. One or more ingredients of the consumable item in the image is identified along with a location of the user and using a neural network, determining one or more similar images from a database. A restaurant associated with each of the one or more similar images is determined along with a similarity score indicating a similarity between the restaurant and the identified content of the image. The one or more restaurants and/or associated similar food items are ranked based on the similarity score and a list of ranked restaurants is provided to the user.Type: GrantFiled: November 23, 2020Date of Patent: November 28, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Julia X. Gong, Jyotkumar Patel, Yale Song, Xuetao Yin, Xiujia Guo, Rajiv S. Binwade, Houdong Hu
-
Patent number: 11694358Abstract: Disclosed are systems and methods for improving interactions with and between computers in content searching, hosting and/or providing systems supported by or configured with devices, servers and/or platforms. The disclosed systems and methods provide an image processing framework that sub-divides computer vision techniques into three computationally efficient steps: detection, classification and matching. These steps provide an improved image processing framework that can analyze live stream data of a media file, in real-time, in order to identify and track specific digital objects depicted therein. This enables not only image processing detection results, but also the capabilities of augmenting the video stream with additional data related to the detected object.Type: GrantFiled: October 26, 2020Date of Patent: July 4, 2023Assignee: Verizon Patent and Licensing Inc.Inventors: Guy Dassa, Yale Song, Jeffrey Scholz, Joao Vitor Baldini Soares, Minho Lee
-
Publication number: 20220417567Abstract: Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods automatically analyze a live streaming media file, and identify portions of the media that are highlights. The content classified as a highlight can be shared across social media platforms, and indexed for searching respective to attributes of the video content. The streaming and highlight media content is renderable in a novel, modified video player that enables variable playback speeds for how content is classified, and enables on-demand selections of specific content portions and adjustable rendering displays during streaming.Type: ApplicationFiled: August 30, 2022Publication date: December 29, 2022Inventors: Bin NI, Kirk LIEB, Rick HAWES, Yale SONG, Benoit SCHILLINGS, Vahe OUGHOURLIAN, Jordi VALLMITJANA, Jennelle NYSTROM, Hardik RUPAREL, Michael CHEN, Adam MATHES, Arunkumar BALASUBRAMANIAN, Jian Zhou, Matt Edelman
-
Patent number: 11438637Abstract: Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods automatically analyze a live streaming media file, and identify portions of the media that are highlights. The content classified as a highlight can be shared across social media platforms, and indexed for searching respective to attributes of the video content. The streaming and highlight media content is renderable in a novel, modified video player that enables variable playback speeds for how content is classified, and enables on-demand selections of specific content portions and adjustable rendering displays during streaming.Type: GrantFiled: May 13, 2020Date of Patent: September 6, 2022Assignee: YAHOO ASSETS LLCInventors: Bin Ni, Kirk Lieb, Rick Hawes, Yale Song, Benoit Schillings, Vahe Oughourlian, Jordi Vallmitjana, Jennelle Nystrom, Hardik Ruparel, Michael Chen, Adam Mathes, Arunkumar Balasubramanian, Jian Zhou, Matt Edelman
-
Publication number: 20220164853Abstract: The present disclosure provides method and apparatus for determining a food item from a photograph and a corresponding restaurant serving the food item. An image is received from a user, the image being associated with a consumable item. One or more ingredients of the consumable item in the image is identified along with a location of the user and using a neural network, determining one or more similar images from a database. A restaurant associated with each of the one or more similar images is determined along with a similarity score indicating a similarity between the restaurant and the identified content of the image. The one or more restaurants and/or associated similar food items are ranked based on the similarity score and a list of ranked restaurants is provided to the user.Type: ApplicationFiled: November 23, 2020Publication date: May 26, 2022Inventors: Julia X GONG, Jyotkumar PATEL, Yale SONG, Xuetao YIN, Xiujia GUO, Rajiv S. BINWADE, Houdong HU
-
Patent number: 11290775Abstract: Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods provide systems and methods for automatically detecting and rendering highlights from streaming videos in real-time. As a streaming video is being broadcast over the Internet, the disclosed systems and methods determine each type of scene from the streaming video, and automatically score highlight scenes. The scored highlight scenes are then communicated to users as compiled video segments, which can be over any type of channel or platform accessible to a user's device and network that enables content rendering and user interaction.Type: GrantFiled: February 12, 2021Date of Patent: March 29, 2022Assignee: YAHOO ASSETS LLCInventors: Yale Song, Jordi Vallmitjana
-
Publication number: 20210168442Abstract: Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods provide systems and methods for automatically detecting and rendering highlights from streaming videos in real-time. As a streaming video is being broadcast over the Internet, the disclosed systems and methods determine each type of scene from the streaming video, and automatically score highlight scenes. The scored highlight scenes are then communicated to users as compiled video segments, which can be over any type of channel or platform accessible to a user's device and network that enables content rendering and user interaction.Type: ApplicationFiled: February 12, 2021Publication date: June 3, 2021Inventors: Yale SONG, Jordi VALLMITJANA
-
Patent number: 10998003Abstract: Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods provide systems and methods for automatically extracting and creating an animated Graphics Interchange Format (GIF) file from a media file. The disclosed systems and methods identify a number of GIF candidates from a video file, and based on analysis of each candidate's attributes, features and/or qualities, as well as determinations related to an optimal playback setting for the content of each GIF candidate, at least one GIF candidate is automatically provided to a user for rendering.Type: GrantFiled: October 23, 2017Date of Patent: May 4, 2021Assignee: VERIZON MEDIA INC.Inventors: Yale Song, Alejandro Jaimes
-
Patent number: 10924800Abstract: Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods provide systems and methods for automatically detecting and rendering highlights from streaming videos in real-time. As a streaming video is being broadcast over the Internet, the disclosed systems and methods determine each type of scene from the streaming video, and automatically score highlight scenes. The scored highlight scenes are then communicated to users as compiled video segments, which can be over any type of channel or platform accessible to a user's device and network that enables content rendering and user interaction.Type: GrantFiled: August 19, 2019Date of Patent: February 16, 2021Assignee: VERIZON MEDIA INC.Inventors: Yale Song, Jordi Vallmitjana
-
Publication number: 20210042960Abstract: Disclosed are systems and methods for improving interactions with and between computers in content searching, hosting and/or providing systems supported by or configured with devices, servers and/or platforms. The disclosed systems and methods provide an image processing framework that sub-divides computer vision techniques into three computationally efficient steps: detection, classification and matching. These steps provide an improved image processing framework that can analyze live stream data of a media file, in real-time, in order to identify and track specific digital objects depicted therein. This enables not only image processing detection results, but also the capabilities of augmenting the video stream with additional data related to the detected object.Type: ApplicationFiled: October 26, 2020Publication date: February 11, 2021Inventors: Guy DASSA, Yale SONG, Jeffrey SCHOLZ, Joao Vitor Baldini SOARES, Minho LEE
-
Patent number: 10832738Abstract: Disclosed are systems and methods for improving interactions with and between computers in content searching, generating, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods automatically generate a thumbnail image from a frame of a video file, where the thumbnail image displays content of a selected frame determined to be high-quality and highly-relevant to the content of the video file. Frames of a video file are analyzed, and the frame that is the most contextually relevant to the video and of the highest visual quality is selected, where a thumbnail image is generated and displayed on a site or application over a network.Type: GrantFiled: May 7, 2018Date of Patent: November 10, 2020Assignee: OATH INC.Inventors: Yale Song, Jordi Vallmitjana, Miriam Redi, Alejandro Jaimes
-
Patent number: 10818033Abstract: Disclosed are systems and methods for improving interactions with and between computers in content searching, hosting and/or providing systems supported by or configured with devices, servers and/or platforms. The disclosed systems and methods provide an image processing framework that sub-divides computer vision techniques into three computationally efficient steps: detection, classification and matching. These steps provide an improved image processing framework that can analyze live stream data of a media file, in real-time, in order to identify and track specific digital objects depicted therein. This enables not only image processing detection results, but also the capabilities of augmenting the video stream with additional data related to the detected object.Type: GrantFiled: February 28, 2018Date of Patent: October 27, 2020Assignee: OATH INC.Inventors: Guy Dassa, Yale Song, Jeffrey Scholz, Joao Vitor Baldini Soares, Minho Lee
-
Patent number: 10776710Abstract: Techniques for multimodal data fusion having a multimodal hierarchical dictionary learning framework that learns latent subspaces with hierarchical overlaps are provided. In one aspect, a method for multi-view data fusion with hierarchical multi-view dictionary learning is provided which includes the steps of: extracting multi-view features from input data; defining feature groups that group together the multi-view features that are related; defining a hierarchical structure of the feature groups; and learning a dictionary using the feature groups and the hierarchy of the feature groups. A system for multi-view data fusion with hierarchical multi-view dictionary learning is also provided.Type: GrantFiled: March 24, 2015Date of Patent: September 15, 2020Assignee: International Business Machines CorporationInventors: Ching-Yung Lin, Zhen Wen, Yale Song
-
Patent number: 10769208Abstract: Disclosed herein is an automated approach for summarizing media content using descriptive information associated with the media content. For example and without limitation, the descriptive information may comprise a title associated with the media content. One or more segments of the media content may be identified to form a media content summary based on each segment's respective similarity to the descriptive information, which respective similarity may be determined using a media content and auxiliary data feature spaces. A shared dictionary of canonical patterns generated using the media content and auxiliary data feature spaces may be used in determining a media content segment's similarity to the descriptive information.Type: GrantFiled: October 4, 2018Date of Patent: September 8, 2020Assignee: OATH INC.Inventors: Yale Song, Jordi Vallmitjana, Amanda Stent, Alejandro Jaimes
-
Publication number: 20200275133Abstract: Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods automatically analyze a live streaming media file, and identify portions of the media that are highlights. The content classified as a highlight can be shared across social media platforms, and indexed for searching respective to attributes of the video content. The streaming and highlight media content is renderable in a novel, modified video player that enables variable playback speeds for how content is classified, and enables on-demand selections of specific content portions and adjustable rendering displays during streaming.Type: ApplicationFiled: May 13, 2020Publication date: August 27, 2020Inventors: Bin NI, Kirk Lieb, Rick Hawes, Yale Song, Benoit Schillings, Vahe Oughourlian, Jordi Vallmitjana, Jennelle Nystrom, Hardik Ruparel, Michael Chen, Adam Mathes, Arunkumar Balasubramanian, Jian Zhou, Matt Edelman
-
Patent number: 10740394Abstract: Disclosed are systems and methods for improving interactions with and between computers in content searching, hosting and/or providing systems supported by or configured with devices, servers and/or platforms. The disclosed systems and methods provide a novel machine-in-the-loop, image-to-video bootstrapping framework that harnesses a training set built upon an image dataset and a video dataset in order to efficiently produce an accurate training set to be applied to frames of videos. The disclosed systems and methods reduce the amount of time required to build the training dataset, and also provide mechanisms to apply the training dataset to any type of content and for any type of recognition task.Type: GrantFiled: March 30, 2018Date of Patent: August 11, 2020Assignee: OATH INC.Inventors: Yale Song, Guy Dassa, Minho Lee, Jeffrey Scholz, Joao Vitor Baldini Soares
-
Patent number: 10681391Abstract: Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods automatically analyze a live streaming media file, and identify portions of the media that are highlights. The content classified as a highlight can be shared across social media platforms, and indexed for searching respective to attributes of the video content. The streaming and highlight media content is renderable in a novel, modified video player that enables variable playback speeds for how content is classified, and enables on-demand selections of specific content portions and adjustable rendering displays during streaming.Type: GrantFiled: July 13, 2016Date of Patent: June 9, 2020Assignee: OATH INC.Inventors: Bin Ni, Kirk Lieb, Rick Hawes, Yale Song, Benoit Schillings, Vahe Oughourlian, Jordi Vallmitjana, Jennelle Nystrom, Hardik Ruparel, Michael Chen, Adam Mathes, Arunkumar Balasubramanian, Jian Zhou, Matt Edelman
-
Patent number: 10623784Abstract: Disclosed herein is a content-adaptive digital media content adjustment system, method and architecture. Playback rate of a media content item comprising audio and video content can be increased by removing a portion of the content item's audio content and a corresponding portion of the content item's video content. An increased playback rate of a multimedia content item is accomplished by decreasing the length of the multimedia content item by removing portions of the multimedia content item's audio and video content.Type: GrantFiled: April 6, 2018Date of Patent: April 14, 2020Assignee: OATH INC.Inventors: Haojian Jin, Zheng Wen, Yale Song
-
Patent number: 10565771Abstract: Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods provide systems and methods for automatically extracting and creating an animated Graphics Interchange Format (GIF) file from a media file. The disclosed systems and methods identify a number of GIF candidates from a video file, and based on analysis of each candidate's attributes, features and/or qualities, at least one GIF candidate is automatically selected for rendering.Type: GrantFiled: March 3, 2018Date of Patent: February 18, 2020Assignee: OATH INC.Inventors: Yale Song, Michael Gygli, Liangliang Cao