Accounting for outcome and process measures in dynamic decision-making tasks through model calibration

  • Varun Dutt (Author)
    Indian Institute of Technology, Mandi

    Varun Dutt, M.S., Ph.D.

    Advisor, Recruitment Cell and Co-advisor, International Relations

    Assistant Professor

    School of Computing and Electrical Engineering

    School of Humanities and Social Sciences

    Indian Institute of Technology Mandi

  • Cleotilde Gonzalez (Author)
    Carnegie Mellon University

    Director, DDMLab
    Associate Research Professor,
    Department of Social and Decision Sciences
    Carnegie Mellon University

Identifiers (Article)

Abstract

Computational models of learning and the theories they represent are often validated by calibrating them to human data on decision outcomes. However, only a few models explain the process by which these decision outcomes are reached. We argue that models of learning should be able to reflect the process through which the decision outcomes are reached, and validating a model on the process is likely to help simultaneously explain both the process as well as the decision outcome. To demonstrate the proposed validation, we use a large dataset from the Technion Prediction Tournament and an existing Instance-based Learning model. We present two ways of calibrating the model’s parameters to human data: on an outcome measure and on a process measure. In agreement with our expectations, we find that calibrating the model on the process measure helps to explain both the process and outcome measures compared to calibrating the model on the outcome measure. These results hold when the model is generalized to a different dataset. We discuss implications for explaining the process and the decision outcomes in computational models of learning.

 

Supplementary files

Supplementary files are available here.

Statistics

loading

Supplementary Content

Published
2015-09-29
Language
en
Type, method or approach
Cognitive Modeling
Keywords
Outcome and Process measures, Computational models of learning, Instance-based learning, Dynamic decisions, Binary choice, Calibration