Symbolic optimal expected time reachability computation and controller synthesis for probabilistic timed automata

Jovanovic, A., Kwiatkowska, M., Norman, G. and Peyras, Q. (2017) Symbolic optimal expected time reachability computation and controller synthesis for probabilistic timed automata. Theoretical Computer Science, 669, pp. 1-21. (doi: 10.1016/j.tcs.2017.01.015)

134444.pdf - Accepted Version
Available under License Creative Commons Attribution Non-commercial No Derivatives.



In this paper we consider the problem of computing the optimal (minimum or maximum) expected time to reach a target and the synthesis of an optimal controller for a probabilistic timed automaton (PTA). Although this problem admits solutions that employ the digital clocks abstraction or statistical model checking, symbolic methods based on zones and priced zones fail due to the difficulty of incorporating probabilistic branching in the context of dense time. We work in a generalisation of the setting introduced by Asarin and Maler for the corresponding problem for timed automata, where simple and nice functions are introduced to ensure finiteness of the dense-time representation. We find restrictions sufficient for value iteration to converge to the optimal expected time on the uncountable Markov decision process representing the semantics of a PTA. We formulate Bellman operators on the backwards zone graph of a PTA and prove that value iteration using these operators equals that computed over the PTA's semantics. This enables us to extract an ε-optimal controller from value iteration in the standard way.

Item Type:Articles
Glasgow Author(s) Enlighten ID:Norman, Dr Gethin
Authors: Jovanovic, A., Kwiatkowska, M., Norman, G., and Peyras, Q.
College/School:College of Science and Engineering > School of Computing Science
Journal Name:Theoretical Computer Science
ISSN (Online):1879-2294
Published Online:07 February 2017
Copyright Holders:Copyright © 2017 Elsevier
First Published:First published in Theoretical Computer Science 669:1-21
Publisher Policy:Reproduced in accordance with the copyright policy of the publisher

University Staff: Request a correction | Enlighten Editors: Update this record