Abstract: A method estimates resource consumption between applications within and among a population of wireless mobile devices. Aggregating and analyzing samples for each member of the population of devices provides comparable individual results. Subsequently aggregating and analyzing only summary information for each member of the population of devices provides cluster, crowd, and global comparisons. An apparatus determines out of norm behavior of an individual within a crowd, or relative differences between two crowds.

Abstract: Systems and methods that automatically collect data associated with system-identified errors as well as data associated with events associated with user-initiated actions. A data collection profile defines data to be collected and a user-initiated trigger. When the user-initiated trigger is sensed, data is collected according to the data collection profile. The collected data can be uploaded immediately, or stored for some period of time before being transmitted to a collection system. A user recognizes an event which may not be recognizable by the system and the user provides an input defined as the user-initiated trigger. Data may be collected for a brief time before, during and a brief time after sensing the user-initiated trigger and may be uploaded to a system. The user may annotate the collected data by explaining the error, after which the explanation is correlated with the collected data.