Abstract: Some embodiments include a stream consolidation engine in a social networking system. The stream consolidation engine can receive two or more input data streams (e.g., an activity record data stream and an application service output stream) from the social networking system. The stream consolidation engine can merge an activity record from the activity record data stream with at least a data record from the input data streams (e.g., from the activity record data stream or the application service output stream) to create a conglomerate data record. The stream consolidation engine can supplement the conglomerate data record with asynchronous information from a data storage or derivative data computed based on content in or referenced by the conglomerate data record. The stream consolidation engine can publish the conglomerate data record in a consolidated data stream. The consolidated data stream can be substantially synchronous to at least one of the input data streams.

Abstract: Some embodiments include a stream consolidation engine in a social networking system. The stream consolidation engine can receive two or more input data streams (e.g., an activity record data stream and an application service output stream) from the social networking system. The stream consolidation engine can merge an activity record from the activity record data stream with at least a data record from the input data streams (e.g., from the activity record data stream or the application service output stream) to create a conglomerate data record. The stream consolidation engine can supplement the conglomerate data record with asynchronous information from a data storage or derivative data computed based on content in or referenced by the conglomerate data record. The stream consolidation engine can publish the conglomerate data record in a consolidated data stream. The consolidated data stream can be substantially synchronous to at least one of the input data streams.

Abstract: Some embodiments include a method of performing a content analysis study around a central theme utilizing a concept study system. The concept study system can generate a classifier machine corresponding to the content analysis study based on a super topic taxonomy including one or more concept identifiers. The concept study system can process a content object, associated with a user activity in a social networking system, through the classifier machine to determine whether to assign the user activity to the content analysis study. The concept study system can aggregate at least an attribute derived from the user activity in a study-specific data container associated with the content analysis study and compute a statistical or analytical insight based on aggregated attributes in the study-specific data container.