Patents by Inventor Yale Song

Yale Song has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240046332
    Abstract: The present disclosure provides method and apparatus for determining a food item from a photograph and a corresponding restaurant serving the food item. An image is received from a user, the image being associated with a consumable item. One or more ingredients of the consumable item in the image is identified along with a location of the user and using a neural network, determining one or more similar images from a database. A restaurant associated with each of the one or more similar images is determined along with a similarity score indicating a similarity between the restaurant and the identified content of the image. The one or more restaurants and/or associated similar food items are ranked based on the similarity score and a list of ranked restaurants is provided to the user.
    Type: Application
    Filed: October 20, 2023
    Publication date: February 8, 2024
    Inventors: Julia X. Gong, Jyotkumar Patel, Yale Song, Xuetao Yin, Xiujia Guo, Rajiv S. Binwade, Houdong Hu
  • Patent number: 11830056
    Abstract: The present disclosure provides method and apparatus for determining a food item from a photograph and a corresponding restaurant serving the food item. An image is received from a user, the image being associated with a consumable item. One or more ingredients of the consumable item in the image is identified along with a location of the user and using a neural network, determining one or more similar images from a database. A restaurant associated with each of the one or more similar images is determined along with a similarity score indicating a similarity between the restaurant and the identified content of the image. The one or more restaurants and/or associated similar food items are ranked based on the similarity score and a list of ranked restaurants is provided to the user.
    Type: Grant
    Filed: November 23, 2020
    Date of Patent: November 28, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Julia X. Gong, Jyotkumar Patel, Yale Song, Xuetao Yin, Xiujia Guo, Rajiv S. Binwade, Houdong Hu
  • Patent number: 11694358
    Abstract: Disclosed are systems and methods for improving interactions with and between computers in content searching, hosting and/or providing systems supported by or configured with devices, servers and/or platforms. The disclosed systems and methods provide an image processing framework that sub-divides computer vision techniques into three computationally efficient steps: detection, classification and matching. These steps provide an improved image processing framework that can analyze live stream data of a media file, in real-time, in order to identify and track specific digital objects depicted therein. This enables not only image processing detection results, but also the capabilities of augmenting the video stream with additional data related to the detected object.
    Type: Grant
    Filed: October 26, 2020
    Date of Patent: July 4, 2023
    Assignee: Verizon Patent and Licensing Inc.
    Inventors: Guy Dassa, Yale Song, Jeffrey Scholz, Joao Vitor Baldini Soares, Minho Lee
  • Publication number: 20220417567
    Abstract: Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods automatically analyze a live streaming media file, and identify portions of the media that are highlights. The content classified as a highlight can be shared across social media platforms, and indexed for searching respective to attributes of the video content. The streaming and highlight media content is renderable in a novel, modified video player that enables variable playback speeds for how content is classified, and enables on-demand selections of specific content portions and adjustable rendering displays during streaming.
    Type: Application
    Filed: August 30, 2022
    Publication date: December 29, 2022
    Inventors: Bin NI, Kirk LIEB, Rick HAWES, Yale SONG, Benoit SCHILLINGS, Vahe OUGHOURLIAN, Jordi VALLMITJANA, Jennelle NYSTROM, Hardik RUPAREL, Michael CHEN, Adam MATHES, Arunkumar BALASUBRAMANIAN, Jian Zhou, Matt Edelman
  • Patent number: 11438637
    Abstract: Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods automatically analyze a live streaming media file, and identify portions of the media that are highlights. The content classified as a highlight can be shared across social media platforms, and indexed for searching respective to attributes of the video content. The streaming and highlight media content is renderable in a novel, modified video player that enables variable playback speeds for how content is classified, and enables on-demand selections of specific content portions and adjustable rendering displays during streaming.
    Type: Grant
    Filed: May 13, 2020
    Date of Patent: September 6, 2022
    Assignee: YAHOO ASSETS LLC
    Inventors: Bin Ni, Kirk Lieb, Rick Hawes, Yale Song, Benoit Schillings, Vahe Oughourlian, Jordi Vallmitjana, Jennelle Nystrom, Hardik Ruparel, Michael Chen, Adam Mathes, Arunkumar Balasubramanian, Jian Zhou, Matt Edelman
  • Publication number: 20220164853
    Abstract: The present disclosure provides method and apparatus for determining a food item from a photograph and a corresponding restaurant serving the food item. An image is received from a user, the image being associated with a consumable item. One or more ingredients of the consumable item in the image is identified along with a location of the user and using a neural network, determining one or more similar images from a database. A restaurant associated with each of the one or more similar images is determined along with a similarity score indicating a similarity between the restaurant and the identified content of the image. The one or more restaurants and/or associated similar food items are ranked based on the similarity score and a list of ranked restaurants is provided to the user.
    Type: Application
    Filed: November 23, 2020
    Publication date: May 26, 2022
    Inventors: Julia X GONG, Jyotkumar PATEL, Yale SONG, Xuetao YIN, Xiujia GUO, Rajiv S. BINWADE, Houdong HU
  • Patent number: 11290775
    Abstract: Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods provide systems and methods for automatically detecting and rendering highlights from streaming videos in real-time. As a streaming video is being broadcast over the Internet, the disclosed systems and methods determine each type of scene from the streaming video, and automatically score highlight scenes. The scored highlight scenes are then communicated to users as compiled video segments, which can be over any type of channel or platform accessible to a user's device and network that enables content rendering and user interaction.
    Type: Grant
    Filed: February 12, 2021
    Date of Patent: March 29, 2022
    Assignee: YAHOO ASSETS LLC
    Inventors: Yale Song, Jordi Vallmitjana
  • Publication number: 20210168442
    Abstract: Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods provide systems and methods for automatically detecting and rendering highlights from streaming videos in real-time. As a streaming video is being broadcast over the Internet, the disclosed systems and methods determine each type of scene from the streaming video, and automatically score highlight scenes. The scored highlight scenes are then communicated to users as compiled video segments, which can be over any type of channel or platform accessible to a user's device and network that enables content rendering and user interaction.
    Type: Application
    Filed: February 12, 2021
    Publication date: June 3, 2021
    Inventors: Yale SONG, Jordi VALLMITJANA
  • Patent number: 10998003
    Abstract: Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods provide systems and methods for automatically extracting and creating an animated Graphics Interchange Format (GIF) file from a media file. The disclosed systems and methods identify a number of GIF candidates from a video file, and based on analysis of each candidate's attributes, features and/or qualities, as well as determinations related to an optimal playback setting for the content of each GIF candidate, at least one GIF candidate is automatically provided to a user for rendering.
    Type: Grant
    Filed: October 23, 2017
    Date of Patent: May 4, 2021
    Assignee: VERIZON MEDIA INC.
    Inventors: Yale Song, Alejandro Jaimes
  • Patent number: 10924800
    Abstract: Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods provide systems and methods for automatically detecting and rendering highlights from streaming videos in real-time. As a streaming video is being broadcast over the Internet, the disclosed systems and methods determine each type of scene from the streaming video, and automatically score highlight scenes. The scored highlight scenes are then communicated to users as compiled video segments, which can be over any type of channel or platform accessible to a user's device and network that enables content rendering and user interaction.
    Type: Grant
    Filed: August 19, 2019
    Date of Patent: February 16, 2021
    Assignee: VERIZON MEDIA INC.
    Inventors: Yale Song, Jordi Vallmitjana
  • Publication number: 20210042960
    Abstract: Disclosed are systems and methods for improving interactions with and between computers in content searching, hosting and/or providing systems supported by or configured with devices, servers and/or platforms. The disclosed systems and methods provide an image processing framework that sub-divides computer vision techniques into three computationally efficient steps: detection, classification and matching. These steps provide an improved image processing framework that can analyze live stream data of a media file, in real-time, in order to identify and track specific digital objects depicted therein. This enables not only image processing detection results, but also the capabilities of augmenting the video stream with additional data related to the detected object.
    Type: Application
    Filed: October 26, 2020
    Publication date: February 11, 2021
    Inventors: Guy DASSA, Yale SONG, Jeffrey SCHOLZ, Joao Vitor Baldini SOARES, Minho LEE
  • Patent number: 10832738
    Abstract: Disclosed are systems and methods for improving interactions with and between computers in content searching, generating, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods automatically generate a thumbnail image from a frame of a video file, where the thumbnail image displays content of a selected frame determined to be high-quality and highly-relevant to the content of the video file. Frames of a video file are analyzed, and the frame that is the most contextually relevant to the video and of the highest visual quality is selected, where a thumbnail image is generated and displayed on a site or application over a network.
    Type: Grant
    Filed: May 7, 2018
    Date of Patent: November 10, 2020
    Assignee: OATH INC.
    Inventors: Yale Song, Jordi Vallmitjana, Miriam Redi, Alejandro Jaimes
  • Patent number: 10818033
    Abstract: Disclosed are systems and methods for improving interactions with and between computers in content searching, hosting and/or providing systems supported by or configured with devices, servers and/or platforms. The disclosed systems and methods provide an image processing framework that sub-divides computer vision techniques into three computationally efficient steps: detection, classification and matching. These steps provide an improved image processing framework that can analyze live stream data of a media file, in real-time, in order to identify and track specific digital objects depicted therein. This enables not only image processing detection results, but also the capabilities of augmenting the video stream with additional data related to the detected object.
    Type: Grant
    Filed: February 28, 2018
    Date of Patent: October 27, 2020
    Assignee: OATH INC.
    Inventors: Guy Dassa, Yale Song, Jeffrey Scholz, Joao Vitor Baldini Soares, Minho Lee
  • Patent number: 10776710
    Abstract: Techniques for multimodal data fusion having a multimodal hierarchical dictionary learning framework that learns latent subspaces with hierarchical overlaps are provided. In one aspect, a method for multi-view data fusion with hierarchical multi-view dictionary learning is provided which includes the steps of: extracting multi-view features from input data; defining feature groups that group together the multi-view features that are related; defining a hierarchical structure of the feature groups; and learning a dictionary using the feature groups and the hierarchy of the feature groups. A system for multi-view data fusion with hierarchical multi-view dictionary learning is also provided.
    Type: Grant
    Filed: March 24, 2015
    Date of Patent: September 15, 2020
    Assignee: International Business Machines Corporation
    Inventors: Ching-Yung Lin, Zhen Wen, Yale Song
  • Patent number: 10769208
    Abstract: Disclosed herein is an automated approach for summarizing media content using descriptive information associated with the media content. For example and without limitation, the descriptive information may comprise a title associated with the media content. One or more segments of the media content may be identified to form a media content summary based on each segment's respective similarity to the descriptive information, which respective similarity may be determined using a media content and auxiliary data feature spaces. A shared dictionary of canonical patterns generated using the media content and auxiliary data feature spaces may be used in determining a media content segment's similarity to the descriptive information.
    Type: Grant
    Filed: October 4, 2018
    Date of Patent: September 8, 2020
    Assignee: OATH INC.
    Inventors: Yale Song, Jordi Vallmitjana, Amanda Stent, Alejandro Jaimes
  • Publication number: 20200275133
    Abstract: Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods automatically analyze a live streaming media file, and identify portions of the media that are highlights. The content classified as a highlight can be shared across social media platforms, and indexed for searching respective to attributes of the video content. The streaming and highlight media content is renderable in a novel, modified video player that enables variable playback speeds for how content is classified, and enables on-demand selections of specific content portions and adjustable rendering displays during streaming.
    Type: Application
    Filed: May 13, 2020
    Publication date: August 27, 2020
    Inventors: Bin NI, Kirk Lieb, Rick Hawes, Yale Song, Benoit Schillings, Vahe Oughourlian, Jordi Vallmitjana, Jennelle Nystrom, Hardik Ruparel, Michael Chen, Adam Mathes, Arunkumar Balasubramanian, Jian Zhou, Matt Edelman
  • Patent number: 10740394
    Abstract: Disclosed are systems and methods for improving interactions with and between computers in content searching, hosting and/or providing systems supported by or configured with devices, servers and/or platforms. The disclosed systems and methods provide a novel machine-in-the-loop, image-to-video bootstrapping framework that harnesses a training set built upon an image dataset and a video dataset in order to efficiently produce an accurate training set to be applied to frames of videos. The disclosed systems and methods reduce the amount of time required to build the training dataset, and also provide mechanisms to apply the training dataset to any type of content and for any type of recognition task.
    Type: Grant
    Filed: March 30, 2018
    Date of Patent: August 11, 2020
    Assignee: OATH INC.
    Inventors: Yale Song, Guy Dassa, Minho Lee, Jeffrey Scholz, Joao Vitor Baldini Soares
  • Patent number: 10681391
    Abstract: Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods automatically analyze a live streaming media file, and identify portions of the media that are highlights. The content classified as a highlight can be shared across social media platforms, and indexed for searching respective to attributes of the video content. The streaming and highlight media content is renderable in a novel, modified video player that enables variable playback speeds for how content is classified, and enables on-demand selections of specific content portions and adjustable rendering displays during streaming.
    Type: Grant
    Filed: July 13, 2016
    Date of Patent: June 9, 2020
    Assignee: OATH INC.
    Inventors: Bin Ni, Kirk Lieb, Rick Hawes, Yale Song, Benoit Schillings, Vahe Oughourlian, Jordi Vallmitjana, Jennelle Nystrom, Hardik Ruparel, Michael Chen, Adam Mathes, Arunkumar Balasubramanian, Jian Zhou, Matt Edelman
  • Patent number: 10623784
    Abstract: Disclosed herein is a content-adaptive digital media content adjustment system, method and architecture. Playback rate of a media content item comprising audio and video content can be increased by removing a portion of the content item's audio content and a corresponding portion of the content item's video content. An increased playback rate of a multimedia content item is accomplished by decreasing the length of the multimedia content item by removing portions of the multimedia content item's audio and video content.
    Type: Grant
    Filed: April 6, 2018
    Date of Patent: April 14, 2020
    Assignee: OATH INC.
    Inventors: Haojian Jin, Zheng Wen, Yale Song
  • Patent number: 10565771
    Abstract: Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods provide systems and methods for automatically extracting and creating an animated Graphics Interchange Format (GIF) file from a media file. The disclosed systems and methods identify a number of GIF candidates from a video file, and based on analysis of each candidate's attributes, features and/or qualities, at least one GIF candidate is automatically selected for rendering.
    Type: Grant
    Filed: March 3, 2018
    Date of Patent: February 18, 2020
    Assignee: OATH INC.
    Inventors: Yale Song, Michael Gygli, Liangliang Cao