We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

econ

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: The Use of Binary Choice Forests to Model and Estimate Discrete Choices

Abstract: Problem definition. In retailing, discrete choice models (DCMs) are commonly used to capture the choice behavior of customers when offered an assortment of products. When estimating DCMs using transaction data, flexible models (such as machine learning models or nonparametric models) are typically not interpretable and hard to estimate, while tractable models (such as the multinomial logit model) tend to misspecify the complex behavior represeted in the data. Methodology/results. In this study, we use a forest of binary decision trees to represent DCMs. This approach is based on random forests, a popular machine learning algorithm. The resulting model is interpretable: the decision trees can explain the decision-making process of customers during the purchase. We show that our approach can predict the choice probability of any DCM consistently and thus never suffers from misspecification. Moreover, our algorithm predicts assortments unseen in the training data. The mechanism and errors can be theoretically analyzed. We also prove that the random forest can recover preference rankings of customers thanks to the splitting criterion such as the Gini index and information gain ratio. Managerial implications. The framework has unique practical advantages. It can capture customers' behavioral patterns such as irrationality or sequential searches when purchasing a product. It handles nonstandard formats of training data that result from aggregation. It can measure product importance based on how frequently a random customer would make decisions depending on the presence of the product. It can also incorporate price information and customer features. Our numerical experiments using synthetic and real data show that using random forests to estimate customer choices can outperform existing methods.
Comments: 61 pages, 10 figures, 30 tables
Subjects: Machine Learning (cs.LG); Econometrics (econ.EM); Machine Learning (stat.ML)
Cite as: arXiv:1908.01109 [cs.LG]
  (or arXiv:1908.01109v5 [cs.LG] for this version)

Submission history

From: Zhuodong Tang [view email]
[v1] Sat, 3 Aug 2019 02:34:49 GMT (417kb,D)
[v2] Sun, 13 Oct 2019 01:43:31 GMT (417kb,D)
[v3] Thu, 14 Nov 2019 10:05:29 GMT (432kb,D)
[v4] Sat, 3 Apr 2021 03:07:27 GMT (524kb,D)
[v5] Wed, 17 Apr 2024 04:02:41 GMT (1122kb,D)

Link back to: arXiv, form interface, contact.