Please use this identifier to cite or link to this item:
http://hdl.handle.net/1942/9677
Title: | Simulation of sequential data: An enhanced reinforcement learning approach | Authors: | VANHULSEL, Marlies JANSSENS, Davy WETS, Geert VANHOOF, Koen |
Issue Date: | 2009 | Publisher: | PERGAMON-ELSEVIER SCIENCE LTD | Source: | EXPERT SYSTEMS WITH APPLICATIONS, 36(4). p. 8032-8039 | Abstract: | The present study aims at contributing to the current state-of-the art of activity-based travel demand modelling by presenting a framework to simulate sequential data. To this end, the suitability of a reinforcement learning approach to reproduce sequential data is explored. Additionally, as traditional reinforcement learning techniques are not capable of learning efficiently in large state and action spaces with respect to memory and computational time requirements on the one hand, and of generalizing based on infrequent visits of all state-action pairs on the other hand, the reinforcement learning technique as used in most applications, is enhanced by means of regression tree function approximation. Three reinforcement learning algorithms are implemented to validate their applicability: the traditional Q-learning and Q-learning with bucket-brigade updating are tested against the improved reinforcement learning approach with a CART function approximator. These methods are applied on data of 26 diary days. The results are promising and show that the proposed techniques offer great opportunity of simulating sequential data. Moreover, the reinforcement learning approach improved by introducing a regression tree function approximator learns a more optimal solution much faster than the two traditional Q-learning approaches. (c) 2008 Elsevier Ltd. All rights reserved. | Notes: | [Vanhulsel, Marlies; Janssens, Davy; Wets, Geert; Vanhoof, Koen] Hasselt Univ, Transportat Res Inst, B-3590 Diepenbeek, Belgium. | Keywords: | Reinforcement learning; Regression tree; Function approximation; Activity-based travel demand modelling | Document URI: | http://hdl.handle.net/1942/9677 | ISSN: | 0957-4174 | e-ISSN: | 1873-6793 | DOI: | 10.1016/j.eswa.2008.10.056 | ISI #: | 000264528600083 | Category: | A1 | Type: | Journal Contribution | Validations: | ecoom 2010 |
Appears in Collections: | Research publications |
Show full item record
SCOPUSTM
Citations
11
checked on Sep 2, 2020
WEB OF SCIENCETM
Citations
15
checked on Oct 11, 2024
Page view(s)
92
checked on Jul 28, 2023
Google ScholarTM
Check
Altmetric
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.