Patents by Inventor Haram JO

Haram JO has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12585700
    Abstract: In order to implement the foregoing object, an exemplary embodiment of the present disclosure discloses a video retrieval method performed by a computing device. The video retrieval method may include: generating one or more sub video data based on one or more video data; identifying, by a machine learning enabled key frame detecting module having one or more encoders, key frame information based on one or more encoded vectors generated from the one or more sub video data; and segmenting the one or more video data into one or more retrieval video data based on the identified key frame information.
    Type: Grant
    Filed: August 8, 2022
    Date of Patent: March 24, 2026
    Assignee: Twelve Labs, Inc.
    Inventors: Seung Joon Lee, Sung Jun Kim, Raehyuk Jung, Haram Jo
  • Patent number: 12579188
    Abstract: In order to implement the foregoing object, an exemplary embodiment of the present disclosure discloses a video retrieval method performed by a computing device. The video retrieval method may include: receiving retrieval query data for one or more video data; generating a retrieval query vector based on the received retrieval query data; comparing the retrieval query vector with a plurality of video retrieval vectors each representing target retrieval video data segmented based on key frame information; and selecting one or more target retrieval video data by the result of the comparison between the retrieval query vector and the plurality of video retrieval vectors.
    Type: Grant
    Filed: July 24, 2024
    Date of Patent: March 17, 2026
    Assignee: Twelve Labs, Inc.
    Inventors: Seung Joon Lee, Sung Jun Kim, Raehyuk Jung, Haram Jo
  • Patent number: 12517949
    Abstract: A video analysis system performs indexing of one or more videos in parallel by using pipelines executed by task processors. A task processor may include compute resources configured on a cloud infrastructure or on-premise compute resources. The video analysis system receives requests to index one or more videos. In one instance, the requests may be from users of client devices with requests to index the videos, such that the indexed information can be used to perform downstream applications, such as search query-based retrieval, and the like. The video analysis system performs the indexing process in parallel, so that significant bottlenecks can be eliminated compared to existing methods.
    Type: Grant
    Filed: March 12, 2025
    Date of Patent: January 6, 2026
    Assignee: Twelve Labs, Inc.
    Inventors: Seung Joon Lee, Sung Jun Kim, Haram Jo, Jong Yeop Park, Michael Stewart, Paul George
  • Publication number: 20250291843
    Abstract: A video analysis system performs indexing of one or more videos in parallel by using pipelines executed by task processors. A task processor may include compute resources configured on a cloud infrastructure or on-premise compute resources. The video analysis system receives requests to index one or more videos. In one instance, the requests may be from users of client devices with requests to index the videos, such that the indexed information can be used to perform downstream applications, such as search query-based retrieval, and the like. The video analysis system performs the indexing process in parallel, so that significant bottlenecks can be eliminated compared to existing methods.
    Type: Application
    Filed: March 12, 2025
    Publication date: September 18, 2025
    Inventors: Seung Joon Lee, Sung Jun Kim, Haram Jo, Jong Yeop Park, Michael Stewart, Paul George
  • Publication number: 20250148010
    Abstract: In order to implement the foregoing object, an exemplary embodiment of the present disclosure discloses a video retrieval method performed by a computing device. The video retrieval method may include: segmenting one or more video data into two or more unit video data; encoding, by one or more encoders comprised in a machine learning enabled key frame detection module, two or more unit video data; generating one or more key frame detection vectors for each of the two or more unit video data based on the result of the encoding; and generating feature vector of one or more retrieval video data based on a combination of one or more vectors among the key frame detection vectors.
    Type: Application
    Filed: December 30, 2024
    Publication date: May 8, 2025
    Inventors: Seung Joon LEE, Sung Jun KIM, Raehyuk JUNG, Haram JO
  • Patent number: 12222985
    Abstract: In order to implement the foregoing object, an exemplary embodiment of the present disclosure discloses a video retrieval method performed by a computing device. The video retrieval method may include: segmenting one or more video data into two or more unit video data; encoding, by one or more encoders comprised in a machine learning enabled key frame detection module, two or more unit video data; generating one or more key frame detection vectors for each of the two or more unit video data based on the result of the encoding; and generating feature vector of one or more retrieval video data based on a combination of one or more vectors among the key frame detection vectors.
    Type: Grant
    Filed: August 8, 2022
    Date of Patent: February 11, 2025
    Assignee: Twelve Labs, Inc.
    Inventors: Seung Joon Lee, Sung Jun Kim, Raehyuk Jung, Haram Jo
  • Publication number: 20250037409
    Abstract: A video analysis system trains and uses a machine-learned adaptive thresholding model configured to receive a query (e.g., text, image, video), and generate a predicted threshold value for a corresponding video retrieval model that indicates what value the filtering threshold should be for the query. The video analysis system filters video segments for the query that are associated with relevance scores above the predicted threshold generated by the adaptive thresholding model. In one instance, the adaptive thresholding model is configured as a machine-learned model, including neural networks, embedding models, transformer-based architectures, and the like that are capable of generating a predicted threshold value given a query that includes, for example, text, images, videos, audio, or any other appropriate data modality.
    Type: Application
    Filed: July 28, 2023
    Publication date: January 30, 2025
    Inventors: Seung Joon Lee, Raehyuk Jung, Haram Jo
  • Publication number: 20240394306
    Abstract: In order to implement the foregoing object, an exemplary embodiment of the present disclosure discloses a video retrieval method performed by a computing device. The video retrieval method may include: receiving retrieval query data for one or more video data; generating a retrieval query vector based on the received retrieval query data; comparing the retrieval query vector with a plurality of video retrieval vectors each representing target retrieval video data segmented based on key frame information; and selecting one or more target retrieval video data by the result of the comparison between the retrieval query vector and the plurality of video retrieval vectors.
    Type: Application
    Filed: July 24, 2024
    Publication date: November 28, 2024
    Inventors: Seung Joon LEE, Sung Jun KIM, Raehyuk JUNG, Haram JO
  • Publication number: 20240338409
    Abstract: Provided is a method of providing a user interface for video retrieval performed by a computing device, the method including: receiving a search query, providing a search result interface displaying at least one search video content and search section searched by the search query, wherein the search video content and the search section are related with at least one of a plurality of video semantic search attributes corresponding to the search query, and providing a timeline view interface for the search video content when it is determined to display the search result interface according to a timeline view mode, wherein the timeline view interface has a visual characteristic indicating the degree of relevance to at least one of the plurality of video semantic search attributes corresponding to the search query.
    Type: Application
    Filed: June 12, 2024
    Publication date: October 10, 2024
    Inventors: Seung Joon Lee, Haram Jo, Eunkyung Yoon, Soyoung Lee, Jae Sung Lee
  • Patent number: 12079273
    Abstract: In order to implement the foregoing object, an exemplary embodiment of the present disclosure discloses a video retrieval method performed by a computing device. The video retrieval method may include: receiving retrieval query data for one or more video data; generating a retrieval query vector based on the received retrieval query data; comparing the retrieval query vector with a plurality of video retrieval vectors each representing target retrieval video data segmented based on key frame information; and selecting one or more target retrieval video data by the result of the comparison between the retrieval query vector and the plurality of video retrieval vectors.
    Type: Grant
    Filed: August 8, 2022
    Date of Patent: September 3, 2024
    Assignee: Twelve Labs, Inc.
    Inventors: Seung Joon Lee, Sung Jun Kim, Raehyuk Jung, Haram Jo
  • Patent number: 12045281
    Abstract: Provided is a method of providing a user interface for video retrieval performed by a computing device, the method including: receiving a search query, providing a search result interface displaying at least one search video content and search section searched by the search query, wherein the search video content and the search section are related with at least one of a plurality of video semantic search attributes corresponding to the search query, and providing a timeline view interface for the search video content when it is determined to display the search result interface according to a timeline view mode, wherein the timeline view interface has a visual characteristic indicating the degree of relevance to at least one of the plurality of video semantic search attributes corresponding to the search query.
    Type: Grant
    Filed: November 10, 2022
    Date of Patent: July 23, 2024
    Assignee: Twelve Labs, Inc.
    Inventors: Seung Joon Lee, Haram Jo, Eunkyung Yoon, Soyoung Lee, Jae Sung Lee
  • Publication number: 20240070197
    Abstract: Provided is a method of providing a user interface for video retrieval performed by a computing device, the method including: receiving a search query, providing a search result interface displaying at least one search video content and search section searched by the search query, wherein the search video content and the search section are related with at least one of a plurality of video semantic search attributes corresponding to the search query, and providing a timeline view interface for the search video content when it is determined to display the search result interface according to a timeline view mode, wherein the timeline view interface has a visual characteristic indicating the degree of relevance to at least one of the plurality of video semantic search attributes corresponding to the search query.
    Type: Application
    Filed: November 10, 2022
    Publication date: February 29, 2024
    Inventors: Seung Joon Lee, Haram Jo, Eunkyung Yoon, Soyoung Lee, Jae Sung Lee
  • Publication number: 20230306056
    Abstract: In order to implement the foregoing object, an exemplary embodiment of the present disclosure discloses a video retrieval method performed by a computing device. The video retrieval method may include: segmenting one or more video data into two or more unit video data; encoding, by one or more encoders comprised in a machine learning enabled key frame detection module, two or more unit video data; generating one or more key frame detection vectors for each of the two or more unit video data based on the result of the encoding; and generating feature vector of one or more retrieval video data based on a combination of one or more vectors among the key frame detection vectors.
    Type: Application
    Filed: August 8, 2022
    Publication date: September 28, 2023
    Inventors: Seung Joon LEE, Sung Jun KIM, Raehyuk JUNG, Haram JO
  • Publication number: 20230281246
    Abstract: In order to implement the foregoing object, an exemplary embodiment of the present disclosure discloses a video retrieval method performed by a computing device. The video retrieval method may include: generating one or more sub video data based on one or more video data; identifying, by a machine learning enabled key frame detecting module having one or more encoders, key frame information based on one or more encoded vectors generated from the one or more sub video data; and segmenting the one or more video data into one or more retrieval video data based on the identified key frame information.
    Type: Application
    Filed: August 8, 2022
    Publication date: September 7, 2023
    Inventors: Seung Joon LEE, Sung Jun KIM, Raehyuk JUNG, Haram JO
  • Publication number: 20230281245
    Abstract: In order to implement the foregoing object, an exemplary embodiment of the present disclosure discloses a video retrieval method performed by a computing device. The video retrieval method may include: receiving retrieval query data for one or more video data; generating a retrieval query vector based on the received retrieval query data; comparing the retrieval query vector with a plurality of video retrieval vectors each representing target retrieval video data segmented based on key frame information; and selecting one or more target retrieval video data by the result of the comparison between the retrieval query vector and the plurality of video retrieval vectors.
    Type: Application
    Filed: August 8, 2022
    Publication date: September 7, 2023
    Inventors: Seung Joon LEE, Sung Jun KIM, Raehyuk JUNG, Haram JO
  • Publication number: 20230281247
    Abstract: In order to implement the foregoing object, an exemplary embodiment of the present disclosure discloses a video retrieval method performed by a computing device. The video retrieval method may include: identifying, by a machine learning enabled key frame detecting module having one or more encoders, key frame information for one or more video data based on one or more encoded vectors respectively generated from one or more unit video data contained in the one or more video data; segmenting the one or more video data into one or more target retrieval video data based on the identified key frame information; and generating, by a machine learning enabled retrieval vector generating module having one or more encoders, one or more retrieval video vectors respectively representing the one or more target retrieval video data.
    Type: Application
    Filed: August 8, 2022
    Publication date: September 7, 2023
    Inventors: Seung Joon LEE, Sung Jun KIM, Raehyuk JUNG, Haram JO