Abstract: A method for generating a transferable synthetic data generation workflow includes determining data properties of a locally-accessible seed dataset for inclusion in a candidate workflow, selecting preprocessing actions for inclusion in the candidate workflow based on the data properties and external requirements for the seed dataset, and storing the candidate workflow as a transferable synthetic data generation workflow in a remotely-accessible workflow storage. The selected preprocessing actions include one or more of data ingestion actions, data conditioning actions, data encoding actions, and data privacy actions. The method may be performed by an onboarding module, which may be included as part of a modular synthetic data generation system including other modules logically isolated from the onboarding module, such as a training module or a generation module.

Abstract: A method of encoding streamed data for use in training a model using a neural network includes ingesting a first streamed dataset corresponding to a first data epoch, updating a streamed dictionary using the first streamed dataset to generate a first dictionary snapshot corresponding to the first data epoch, and encoding the first streamed dataset using the first dictionary snapshot to generate a first encoded dataset. A program may be stored in non-transitory computer-readable media. The program may include instructions that, when executed by one or more processors, encode streamed data for use in training a model using a neural network by performing the method. A synthetic data generation system may include a streamed data source, an encoding storage configured to store a streamed dictionary, the one or more processors, and the non-transitory computer-readable media.

Abstract: A system and method for determining sentiment comprising receiving textual data, identifying a context for the textual data, selecting and/or modifying a natural language processor based on the context, analyzing the textual data with the natural language processor for a sentiment determination, and storing the sentiment determination on a non-transitory computer readable medium.

Abstract: A system and method for receiving social media data from multiple social media websites, categorizing the social media data, scoring the social media data, creating clusters of social media data and scoring and ranking the clusters of social media data.

Abstract: A system and method for determining intent of posters to a social media site for a predetermined topic through the analysis of the poster's posts. The system and method also allows for extrapolation and predictive analysis of the intent data determinations to provide insight into the views and intent of the general populace regarding a selected topic.