Understanding Aesthetic PreferenceJosh Bongard
[1] How do we come to find one object more appealing than another? Why does this preference differ between people? On what do we base our decision? How much 'thought' do we put into making a choice?

This interactive online experiment is an attempt to provide some answers to these questions. It should take about five minutes of your time, and on completion provides individual feedback about your choices. After taking the test, your results will be displayed. To get involved...

[The experiment has concluded. Notification will be made when a new version is ready.]

[2] You have not yet taken or completed the experiment.
[3] Ability of Models to Predict 0 Users' Behavior[4] The graph to the left illustrates how well a set of artificial neural networks (ANNs) do at modeling an aspect of human cognition: aesthetic preference. Right now, 0 users are taking the experiment; 0 users have finished the experiment. For each user, 30 ANNs have tried to model the behavior of him or her by observing which image they choose from among a pair of images. If the ANNs failed to model the user's behavior, then their predictions about the user's choices should be no better than 50%. This is equivalent to a human predicting the outcome of a flipped coin: they would be right half of the time.

The red bars on the left show ANNs that simply make random predictions about the users: as expected, the ANNs' prediction rates tend to hover around 50%. The green bars show the prediction rates of all of the ANNs that were trained while the user made their choices. If they learned something, they should be able to predict much better than 50%. If not, the green bars should correspond more or less to the red bars. If the center of mass of the green graph is lower than the red graph, then the ANNs are generally successful.
0 to 10%
10 to 20%
20 to 30%
30 to 40%
40 to 50%
50 to 60%
60 to 70%
70 to 80%
80 to 90%
90 to 100%
Random ModelsAccuracyTrained Models
[5] Prediction Accuracy of Random/Individualized Tests[6] Users are broken into two groups. The first group is presented with previously-created images (random tests). The second group has images made specifically for them, while they are making their choices (individualized tests). Users cannot tell to which of these two groups they were assigned. These individualized tests are made specifically to help the ANNs better understand the user's choosing strategy.

The graph to the left shows how the ANNs did when supported by random tests (red bars) versus ANNs supported by individualized tests (green bars). The graph illustrates whether creating individualized tests actually aids modeling: if they do, then the green bars should lie lower than the red bars; if the individualized tests do not help, there should be no observable difference between the two curves.
0 to 10%
10 to 20%
20 to 30%
30 to 40%
40 to 50%
50 to 60%
60 to 70%
70 to 80%
80 to 90%
90 to 100%
Random TestsAccuracyIndividualized Tests
Department of Computer ScienceUniversity of Vermont