{"type":"ScholarlyArticle","title":"Learning Probabilistic Temporal Logic Specifications for Stochastic Systems","authors":[{"name":"Rajarshi Roy","slug":"rajarshi-roy","given":"Rajarshi","family":"Roy","affiliation":""},{"name":"Yash Pote","slug":"yash-pote","given":"Yash","family":"Pote","affiliation":""},{"name":"Dave Parker","slug":"dave-parker","given":"Dave","family":"Parker","affiliation":""},{"name":"Marta Kwiatkowska","slug":"marta-kwiatkowska","given":"Marta","family":"Kwiatkowska","affiliation":""}],"abstract":"There has been substantial progress in the inference of formal behavioural specifications from sample trajectories, for example using Linear Temporal Logic (LTL). However, these techniques cannot handle specifications that correctly characterise systems with stochastic behaviour, which occur commonly in reinforcement learning and formal verification. We consider the passive learning problem of inferring a Boolean combination of probabilistic LTL (PLTL) formulas from a set of Markov chains, classified as either positive or negative. We propose a novel learning algorithm that infers concise PLTL specifications, leveraging grammar-based enumeration, search heuristics, probabilistic model checking and Boolean set-cover procedures. We demonstrate the effectiveness of our algorithm in two use cases: learning from policies induced by RL algorithms and learning from variants of a probabilistic model. In both cases, our method automatically and efficiently extracts PLTL specifications that succinctly characterize the temporal differences between the policies or model variants.","doi":"10.24963/ijcai.2025/517","url":"https://ijcai.org/proceedings/2025/517","pdf":"https://ijcai.org/proceedings/2025/0517.pdf","markdown":"https://ijcai.org/proceedings/2025/517.md","bibtex":"https://ijcai.org/proceedings/2025/bibtex/517","volume":{"slug":"2025","title":"Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2025","url":"https://ijcai.org/proceedings/2025/","year":2025,"location":"Montreal, Canada","dates":"16-22 August 2025","editors":"James Kwok","isbn":"978-1-956792-06-5","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2025"},"section":"Knowledge Representation and Reasoning","track":"Main Track","number":517,"pages":{"first":4642,"last":4650},"keywords":["Uncertainty in AI: UAI: Uncertainty representations","Knowledge Representation and Reasoning: KRR: Knowledge representation languages","Planning and Scheduling: PS: Planning under uncertainty"],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}