Abstract: Apparatus and methods present a content item and question from an inquirer to a group of users in a first feedback session with a requirement for the users to provide predictions of how a member of a distinct target group will respond to the content item, receiving, during the first feedback session, the first group's prediction of the target group's responses, presenting, during a second feedback session, the same content item and the same question to the target group with a requirement for the target group to provide responses directed to their own responses, constructing a predictive model of the target group based on responses received from the target group during the second feedback session, measuring accuracy of the first group's predictions using the target group predictive model and providing the inquirer access to an ordered visual representation of the first group users arranged as a function of accuracy.

Abstract: Apparatus and methods present a content item and question from an inquirer to a group of users in a first feedback session with a requirement for the users to provide predictions of how a member of a distinct target group will respond to the content item, receiving, during the first feedback session, the first group's prediction of the target group's responses, presenting, during a second feedback session, the same content item and the same question to the target group with a requirement for the target group to provide responses directed to their own responses, constructing a predictive model of the target group based on responses received from the target group during the second feedback session, measuring accuracy of the first group's predictions using the target group predictive model and providing the inquirer access to an ordered visual representation of the first group users arranged as a function of accuracy.

Abstract: Apparatus and methods present a content item and question from an inquirer to a group of users in a first feedback session with a requirement for the users to provide predictions of how a member of a distinct target group will respond to the content item, receiving, during the first feedback session, the first group's prediction of the target group's responses, presenting, during a second feedback session, the same content item and the same question to the target group with a requirement for the target group to provide responses directed to their own responses, constructing a predictive model of the target group based on responses received from the target group during the second feedback session, measuring accuracy of the first group's predictions using the target group predictive model and providing the inquirer access to an ordered visual representation of the first group users arranged as a function of accuracy.

Abstract: Presenting a content item and a question from an inquirer to a group of users in a first feedback session with a requirement for the users to provide predictions of how a member of a distinct target group will respond to the content item in the future, receiving, during the first feedback session, the first group's prediction of the target group's future responses, presenting, during a second feedback session, the same content item and the same question to the target group with a requirement for the target group to provide responses directed to their own responses, constructing a predictive model of the target group based on responses received from the target group during the second feedback session, measuring accuracy of the first group's prediction using the target group predictive model, and providing inquirer access to the predictive model of the target group and the most accurate prediction.

Abstract: The present disclosure relates to a system, method, and apparatus that incentivizes users to give thoughtful answers when completing reviews by only rewarding, a portion of users that complete the reviews. An item (e.g., an advertisement, product design, or logo) may be presented to a number of users along with a query about the item. Answers may be received from the users and a comparison value may be calculated for the answers. A deviation value may then be determined for each user between the answer the user provided and the comparison value. The number of users may then be ranked according to their respective deviation values with a lower deviation value corresponding to a lower ranking. One or more users with the lowest rankings may then be provided with a reward.

Abstract: The present disclosure relates to a system, method, and apparatus that incentivizes users to give thoughtful answers when completing reviews by only rewarding a portion of users that complete the reviews. An item (e.g., an advertisement, product design, or logo) may be presented to a number of users along with a query about the item. Answers may be received from the users and a comparison value may be calculated for the answers. A deviation value may then be determined for each user between the answer the user provided and the comparison value. The number of users may then be ranked according to their respective deviation values with a lower deviation value corresponding to a lower ranking. One or more users with the lowest rankings may then be provided with a reward.