Q-learning using fuzzified states and weighted actions and its application to omni-direnctional mobile robot control

Cited 4 time in webofscience Cited 0 time in scopus
  • Hit : 408
  • Download : 0
The conventional Q-learning algorithm is described by a finite number of discretized states and discretized actions. When the system is represented in continuous domain, this may cause an abrupt transition of action as the state rapidly changes. To avoid this abrupt transition of action, the learning system requires fine-tuned states. However, the learning time significantly increases and the system becomes computationally expensive as the number of states increases. To solve this problem, this paper proposes a novel Q-learning algorithm, which uses fuzzified states and weighted actions to update its state-action value. By applying the concept of fuzzy set to the states of Q-learning and using the weighted actions, the agent efficiently responds to the rapid changes of the states. The proposed algorithm is applied to omni-directional mobile robot and the results demonstrate the effectiveness of the proposed approach.
Publisher
CIRA'09
Issue Date
2009-12-15
Language
English
Citation

2009 IEEE International Symposium on Computational Intelligence in Robotics and Automation, pp.102 - 107

DOI
10.1109/CIRA.2009.5423227
URI
http://hdl.handle.net/10203/155169
Appears in Collection
EE-Conference Papers(학술회의논문)
Files in This Item
There are no files associated with this item.
This item is cited by other documents in WoS
⊙ Detail Information in WoSⓡ Click to see webofscience_button
⊙ Cited 4 items in WoS Click to see citing articles in records_button

qr_code

  • mendeley

    citeulike


rss_1.0 rss_2.0 atom_1.0