Patents Assigned to CLARIFAI, INC.
  • Patent number: 11068523
    Abstract: In certain embodiments, media item search and machine learning system training may be facilitated. In some embodiments, a first set of media items may be obtained (based on performance of a query) and presented on a user interface. A user selection of a media item of the first set may be obtained, and the query may be updated based on the user-selected media item. A second set of media items may be obtained based on performance of the updated query, and media items of the second set may be assigned to a group based on their similarities with one another. A predicted name for the group may be determined via a machine learning system and presented on the user interface. A user-indicated update to the predicted name for the group may be obtained and provided to the machine learning system to train the machine learning system.
    Type: Grant
    Filed: February 15, 2019
    Date of Patent: July 20, 2021
    Assignee: Clarifai, Inc.
    Inventors: Matthew D. Zeiler, Adam L. Berenzweig
  • Patent number: 11068159
    Abstract: Keyboard-based search of local and/or connected digital media items may be facilitated. A digital media item search interface may be presented in the same view as a messaging interface. The digital media item search interface may receive input such as from an on-screen keyboard to facilitate editing of user-provided search queries and submission of the user-provided search queries. The digital media item search interface may present digital media item tags relating to context information based on input received by the digital media item search query field. The digital media item search interface may present visual previews of local and/or connected digital media items corresponding to digital media item tags presented in the digital media item tag field. The digital media item search interface may receive user selections of individual digital media items to be communicated to one or more other users via the messaging interface.
    Type: Grant
    Filed: August 31, 2016
    Date of Patent: July 20, 2021
    Assignee: Clarifai, Inc.
    Inventors: Matthew Zeiler, John Rogers, John Sloan, Jason Culler
  • Patent number: 11030492
    Abstract: A previously trained classification model associated with the machine learning system is configured to process an input to generate i) a first prediction that represents a characteristic associated with the input, and ii) a representation of accuracy associated with the prediction. A retraining subsystem is configured to receive the input, the first prediction, and the representation of accuracy. The retraining subsystem processes the input to generate a prediction representing a characteristic. A sufficiency of certainty of the first prediction is determined based on at least the input, the first prediction, the measure of accuracy, and the second prediction. Based at least on the determined sufficiency the retraining subsystem causes the machine learning system to be automatically retrained, be retrained using the input with active learning or not retrained.
    Type: Grant
    Filed: January 16, 2019
    Date of Patent: June 8, 2021
    Assignee: CLARIFAI, INC.
    Inventors: Matthew Zeiler, Jesse Rappaport, Samuel Dodge, Michael Gormish
  • Patent number: 10921957
    Abstract: In certain embodiments, a neural network may be trained to associated context information with multimedia items. In some embodiments, context predictions for multimedia items may be obtained via a neural network. A first multimedia item and a first task related to a first context prediction for the first multimedia item may be presented on a user interface. A user response to the first task may be obtained via the user interface. Based on the user response to the first task, prediction feedback related to the first context prediction or the first multimedia item may be provided to the neural network to cause the neural network to be updated based on the prediction feedback.
    Type: Grant
    Filed: January 18, 2019
    Date of Patent: February 16, 2021
    Assignee: Clarifai, Inc.
    Inventors: Matthew D. Zeiler, Adam L. Berenzweig
  • Patent number: 10867241
    Abstract: Off-line deep neural network operations on client computing platforms may be enabled by cooperative machine learning across multiple client computing platforms and the cloud. A given client computing platform may include a client-side machine learning model configured to facilitate deep neural network operations on structured data. The operations may be performed by a client application installed on the given client computing platform. The client application may locally access the client-side machine learning model in order to perform the operations. Deep neural network operations on structured data may be performed at one or more servers. Sharing of model states may be facilitated between the cloud machine learning model and the client-side machine learning model. The cloud machine learning model may be improved, at one or more servers, based on usage of the application and user interactions with the given client computing platform.
    Type: Grant
    Filed: September 26, 2016
    Date of Patent: December 15, 2020
    Assignee: Clarifai, Inc.
    Inventors: John Rogers, Kevin Most, Matthew Zeiler
  • Patent number: 10866705
    Abstract: In certain implementations, a user request to add a new concept may be received. A set of media item recommendations may be caused to be loaded on a user interface for presentation to a user responsive to the user request to add the new concept. The media item recommendation set may include a set of recommendations loaded on an on-screen portion of the user interface and a set of recommendations loaded on an off-screen portion of the user interface. The on-screen user interface portion is visible to the user at a first time. The off-screen user interface portion is not being visible to the user at the first time. A user selection of one or more recommendations of the on-screen recommendation set is received. The off-screen recommendation set may be caused to be updated on the user interface during the presentation of the media item recommendation set based on the user recommendation selection.
    Type: Grant
    Filed: December 5, 2016
    Date of Patent: December 15, 2020
    Assignee: Clarifai, Inc.
    Inventors: John Rogers, Keith Ito, Marshall Jones, Daniel Kantor, Matthew Zeiler
  • Publication number: 20200380319
    Abstract: In certain embodiments, training of a prediction model (e.g., recognition or other prediction model) may be facilitated via a training set based on one or more logos or other graphics. In some embodiments, graphics information associated with a logo or graphic (e.g., to be recognized via a recognition model) may be obtained. Media items (e.g., images, videos, etc.) may be generated based on the graphics information, where each of the media items includes (i) content other than the logo and (ii) a given representation of the logo integrated with the other content. In some embodiments, the media items may be processed via the recognition model to generate predictions (related to recognition of the logo or graphic for the media items). The recognition model may be updated based on (i) the generated predictions and (ii) corresponding reference indications (related to recognition of the logo for the media items).
    Type: Application
    Filed: August 20, 2020
    Publication date: December 3, 2020
    Applicant: Clarifai, Inc.
    Inventors: David Joshua Eigen, Matthew Zeiler
  • Patent number: 10853704
    Abstract: In some embodiments, reduction of computational resource usage related to image labeling and/or segmentation may be facilitated. In some embodiments, a collection of images may be used to train one or more prediction models. Based on a presentation of an image on a user interface, an indication of a target quantity of superpixels for the image may be obtained. The image may be provided to a first prediction model to cause the prediction model to predict a quantity of superpixels for the image. The target quantity of superpixels may be provided to the first model to update the first model's configurations based on (i) the predicted quantity and (ii) the target quantity. A set of superpixels may be generated for the image based on the target quantity, and segmentation information related to the superpixels set may be provided to a second prediction model to update the second model's configurations.
    Type: Grant
    Filed: December 18, 2018
    Date of Patent: December 1, 2020
    Assignee: Clarifai, Inc.
    Inventors: Yanan Jian, Matthew Zeiler, Marshall Jones
  • Publication number: 20200374596
    Abstract: Systems and methods for browsing, searching, and/or viewing video with associated semantic labels via a user interface are presented herein. Presentation of a user interface may be effectuated. The user interface may be configured to display scenes of one or more videos and/or one or more semantic labels associated with the scenes. A first scene associated with a first video and a first semantic label associated with the first scene may be displayed in the user interface. Playback of the first video in the user interface may cause one or more changes in the display of semantic labels over time, such that responsive to playback of the first video including display of a second scene after the first scene, a second semantic label is displayed and the first semantic label is no longer displayed. The second semantic label may be associated with the second scene.
    Type: Application
    Filed: August 11, 2020
    Publication date: November 26, 2020
    Applicant: CLARIFAI, INC.
    Inventors: Matthew D. ZEILER, Adam L. Berenzweig, Christopher Yan
  • Patent number: 10779060
    Abstract: In certain embodiments, training of a neural network or other prediction model may be facilitated via live stream concept association. In some embodiments, a live video stream may be loaded on a user interface for presentation to a user. A user selection related to a frame of the live video stream may be received via the user interface during the presentation of the live video stream on the user interface, where the user selection indicates a presence of a concept in the frame of the live video stream. In response to the user selection related to the frame, an association of at least a portion of the frame of the live video stream and the concept may be generated, and the neural network or other prediction model may be trained based on the association of at least the portion of the frame with the concept.
    Type: Grant
    Filed: May 22, 2018
    Date of Patent: September 15, 2020
    Assignee: Clarifai, Inc.
    Inventors: Matthew D. Zeiler, Daniel Kantor
  • Patent number: 10776675
    Abstract: In certain embodiments, training of a prediction model (e.g., recognition or other prediction model) may be facilitated via a training set generated based on one or more logos or other graphics. In some embodiments, graphics information associated with a logo or graphic (e.g., to be recognized via a recognition model) may be obtained. Training media items (e.g., images, videos, etc.) may be generated based on the graphics information, where each of the training media items includes (i) content other than the logo and (ii) a given representation of the logo integrated with the other content. The training media items may be processed via the recognition model to generate predictions (related to recognition of the logo or graphic for the training media items). The recognition model may be updated based on (i) the generated predictions and (ii) corresponding reference indications (related to recognition of the logo for the training media items).
    Type: Grant
    Filed: December 10, 2018
    Date of Patent: September 15, 2020
    Assignee: Clarifai, Inc.
    Inventors: David Joshua Eigen, Matthew Zeiler
  • Patent number: 10750245
    Abstract: Systems and methods for browsing, searching, and/or viewing video with associated semantic labels via a user interface are presented herein. Presentation of a user interface may be effectuated. The user interface may be configured to display scenes of one or more videos and/or one or more semantic labels associated with the scenes. A first scene associated with a first video and a first semantic label associated with the first scene may be displayed in the user interface. Playback of the first video in the user interface may cause one or more changes in the display of semantic labels over time, such that responsive to playback of the first video including display of a second scene after the first scene, a second semantic label is displayed and the first semantic label is no longer displayed. The second semantic label may be associated with the second scene.
    Type: Grant
    Filed: October 24, 2019
    Date of Patent: August 18, 2020
    Assignee: Clarifai, Inc.
    Inventors: Matthew D. Zeiler, Adam L. Berenzweig, Christopher Yan
  • Patent number: 10498799
    Abstract: In certain embodiments, automated routing of media items between user devices may be facilitated. In some embodiments, a routing computer system may automatically obtain images or videos from one or more sources. The routing computer system may perform object recognition on the contents of the images or videos to identify individuals or other objects in the images or videos. The routing computer system may assign first and second images or videos of the images or videos to a first media item group based on (i) the first and second images or videos having similar metadata and (ii) the object recognition identifying an individual or object in the first image or video and an individual or object in the second image or video that are similar to each other. The routing computer system may automatically transmit the first image or video to one or more user devices based on the assignment.
    Type: Grant
    Filed: May 22, 2018
    Date of Patent: December 3, 2019
    Assignee: CLARIFAI, INC.
    Inventors: Matthew D. Zeiler, Keith Ito, Adam L. Berenzweig
  • Patent number: 10331675
    Abstract: A system configured for learning new trained concepts used to retrieve content relevant to the concepts learned. The system may comprise one or more hardware processors configured by machine-readable instructions to obtain one or more digital media items. The one or more hardware processors may be further configured to obtain an indication conveying a concept to be learned from the one or more digital media items. The one or more hardware processors may be further configured to receive feedback associated with individual ones of the one or more digital media items. The one or more hardware processors may be configured to obtain individual neural network representations for the individual ones of the one or more digital media items. The one or more hardware processors may be configured to determine a trained concept based on the feedback and the neural network representations of the one or more digital media items.
    Type: Grant
    Filed: August 6, 2015
    Date of Patent: June 25, 2019
    Assignee: CLARIFAI, INC.
    Inventor: Matthew D. Zeiler
  • Patent number: 10296826
    Abstract: A system configured for learning new trained concepts used to retrieve content relevant to the concepts learned. The system may comprise one or more hardware processors configured by machine-readable instructions to obtain one or more digital media items. The one or more hardware processors may be further configured to obtain an indication conveying a concept to be learned from the one or more digital media items. The one or more hardware processors may be further configured to receive feedback associated with individual ones of the one or more digital media items. The one or more hardware processors may be configured to obtain individual neural network representations for the individual ones of the one or more digital media items. The one or more hardware processors may be configured to determine a trained concept based on the feedback and the neural network representations of the one or more digital media items.
    Type: Grant
    Filed: August 6, 2015
    Date of Patent: May 21, 2019
    Assignee: CLARIFAI, INC.
    Inventor: Matthew D. Zeiler
  • Patent number: 10262060
    Abstract: Systems and methods for facilitating searching, labeling, and/or filtering of digital media items are described. Users may provide queries for digital media items. Results from a search may be presented to the users. A user may provide selection of one or more displayed digital media items. A user selection may provide a digital media item exemplar that may be used to update the user-provided queries. Further searches based on the updated queries may be performed. A repository of digital media items may be queried both with an original text query supplied by a user and an updated query based user selection of digital media items returned from the original text query search. A user may be able to refine an initial text, image, and/or other query without having to know additional search terms.
    Type: Grant
    Filed: July 6, 2015
    Date of Patent: April 16, 2019
    Assignee: CLARIFAI, INC.
    Inventors: Matthew D. Zeiler, Adam L. Berenzweig
  • Patent number: 10222942
    Abstract: Context information may be associated with multimedia items. One or more multimedia items may be obtained from a repository, the multimedia items(s) including one or more of an image, a video, audio, a text file, combinations thereof, and/or other considerations. Predicted context information may be associated with individual ones of the multimedia items. Labels and/or other context information associated with multimedia item(s) may be stored as metadata associated with the multimedia item(s). A user interface may be configured to display one or more of the obtained multimedia items and the predicted context information associated with the one or more obtained multimedia items. Entry and/or selection may be obtained from one or more users of an addition, removal, correction, and/or confirmation of the predicted context information for individual ones of the multimedia items and/or groups of multimedia items displayed in the user interfaces.
    Type: Grant
    Filed: January 20, 2016
    Date of Patent: March 5, 2019
    Assignee: CLARIFAI, INC.
    Inventors: Matthew D. Zeiler, Adam L. Berenzweig
  • Patent number: 10163043
    Abstract: In certain embodiments, training of a prediction model (e.g., recognition or other prediction model) may be facilitated via a training set generated based on one or more logos or other graphics. In some embodiments, graphics information associated with a logo or graphic (e.g., to be recognized via a recognition model) may be obtained. Training media items (e.g., images, videos, etc.) may be generated based on the graphics information, where each of the training media items includes (i) content other than the logo and (ii) a given representation of the logo integrated with the other content. The training media items may be processed via the recognition model to generate predictions (related to recognition of the logo or graphic for the training media items). The recognition model may be updated based on (i) the generated predictions and (ii) corresponding reference indications (related to recognition of the logo for the training media items).
    Type: Grant
    Filed: March 31, 2017
    Date of Patent: December 25, 2018
    Assignee: CLARIFAI, INC.
    Inventors: David Joshua Eigen, Matthew Zeiler
  • Patent number: 10051036
    Abstract: Systems and methods for facilitating the sharing of digital media items between source computing platforms and end computing platforms based on information associated with and/or derived from the media items are presented herein. Automatic routing of a media item to one or more users may be in response to obtaining digital media items, such as a photo, a video, an audio file, or text file, from one or more media item source computing platforms, obtaining information associated with individual ones of the media items, and associating one or more media items with one or more groups based on the obtained information. Other aspects of the disclosure may be related to making media items easy to locate, generating notifications to one or more users who have indicated interest in a media item and/or media item group, suggesting that a media item be shared with one or more users, and/or other features.
    Type: Grant
    Filed: January 20, 2016
    Date of Patent: August 14, 2018
    Assignee: CLARIFAI, INC.
    Inventors: Matthew D. Zeiler, Keith Ito, Adam L. Berenzweig
  • Patent number: 10051344
    Abstract: In certain embodiments, training of a neural network or other prediction model may be facilitated via live stream concept association. In some embodiments, a live video stream may be loaded on a user interface for presentation to a user. A user selection related to a frame of the live video stream may be received via the user interface during the presentation of the live video stream on the user interface, where the user selection indicates a presence of a concept in the frame of the live video stream. In response to the user selection related to the frame, an association of at least a portion of the frame of the live video stream and the concept may be generated, and the neural network or other prediction model may be trained based on the association of at least the portion of the frame with the concept.
    Type: Grant
    Filed: September 27, 2017
    Date of Patent: August 14, 2018
    Assignee: CLARIFAI, INC.
    Inventors: Matthew Zeiler, Daniel Kantor