Document Type

Conference Paper

Department/Unit

Department of Computer Science

Title

A novel orthogonal NMF-based belief compression for POMDPs

Language

English

Abstract

High dimensionality of POMDP's belief state space is one major cause that makes the underlying optimal policy computation intractable. Belief compression refers to the methodology that projects the belief state space to a low-dimensional one to alleviate the problem. In this paper, we propose a novel orthogonal non-negative matrix factorization (O-NMF) for the projection. The proposed O-NMF not only factors the belief state space by minimizing the reconstruction error, but also allows the compressed POMDP formulation to be efficiently computed (due to its orthogonality) in a value-directed manner so that the value function will take same values for corresponding belief states in the original and compressed state spaces. We have tested the proposed approach using a number of benchmark problems and the empirical results confirms its effectiveness in achieving substantial computational cost saving in policy computation.

Publication Date

6-2007

Source Publication Title

Proceedings of the 24th international conference on Machine learning (ICML'07)

Editors

Ghahramani, Zoubin ; ACM Digital Library

Start Page

537

End Page

544

Conference Location

Corvalis, United States

Publisher

ACM

Copyright

Copyright 2007 by the author(s)/ owner(s)

Funder

This work has been partially supported by RGC Central Allocation Group Research Grant (HKBU 2/03/C) and HKBU Faculty Research Grant (FRG/05-06/II-81).

DOI

10.1145/1273496.1273564

Link to Publisher's Edition

http://dx.doi.org/10.1145/1273496.1273564

ISBN (print)

9781595937933

This document is currently not available here.

Share

COinS