Research

Relative value learning

Decision makers sometimes have to use feedback from the environment to learn the values of different options. When options are repeatedly encountered in separate contexts, people may learn the values of those options in a context-dependent fashion. Instead of encoding absolute outcomes, people behave as if they encode relative outcomes (e.g., “X usually gives better outcomes than Y”). Learning relative outcomes in one context and then using them to make decisions in a new context may lead to "irrational" preferences for options with lower payoffs. 

Whether absolute or relative outcomes end up getting encoded may depend on the information attended to during training. For example, we found that individuals who attend to their feelings associated with options learn the relative values of those options, whereas those who attend to expected payoffs show greater encoding of absolute outcomes.

We have also been developing a computational model of context-dependent outcome encoding and learning. Our model says that people track the frequency with which options give better relative outcomes than other options (regardless of magnitude), and they tend to choose options that give better outcomes most of the time. In one study, we showed that our "frequency encoding" model provided a better account of human choice data than other candidate models.

Relevant papers and presentations

Hayes, W. M., & Wedell, D. H. (2023). Reinforcement learning in and out of context: The effects of attentional focus. Journal of Experimental Psychology: Learning, Memory, and Cognition, 49(8), 1193-1217. (link)

Hayes, W. M., & Wedell, D. H. (2023). Testing models of context-dependent outcome encoding in reinforcement learning. Cognition, 230, 105280. (link)

Hayes, W. M., & Wedell, D. H. (2023). Effects of blocked versus interleaved training on relative value learning. Psychonomic Bulletin & Review. Advance online publication. (link)

Context Effects in Decision Making

In decisions between multiple alternatives with multiple attributes, the relative preference for one alternative over another often depends on other, "irrelevant" alternatives. These context effects are notoriously fragile and can disappear or even reverse depending on the way that information is presented. The fragile nature of context effects may be partly due to attentional processes. Different choice presentation formats facilitate certain types of comparisons while making other types of comparisons more difficult, thereby decreasing the likelihood of attending to the latter. For example, incommensurable attributes, such as CPU speed (GHz) and RAM size (GB) for laptops, should be more difficult to compare than attributes on a common scale, such as quality ratings. The varying levels of attention allocated to different attribute comparisons may then influence the occurrence or nonoccurrence of context effects. 

We are currently planning experiments that will leverage process tracing methods (eye-tracking and Mouselab technology) to directly test this hypothesis.


Relevant papers and presentations

Hayes, W. M., Holmes, W. R., & Trueblood, J. S. (submitted). Attribute comparability and context effects in preferential choice.

Trueblood, J. S., Liu, Y., Murrow, M., Hayes, W. M., & Holmes, W. R. (submitted). Attentional dynamics explain the elusive nature of context effects.

Dr. Hayes will be giving a talk entitled "Attribute Comparability and Context Effects in Preferential Choice" at the 2023 Annual Meeting of the Psychonomic Society (November 18, 2023).