---
title: "Moral Planning Agents with LTL Values"
authors:
  - "Umberto Grandi"
  - "Emiliano Lorini"
  - "Timothy Parker"
doi: "10.24963/ijcai.2023/47"
url: "https://ijcai.org/proceedings/2023/47"
pdf: "https://ijcai.org/proceedings/2023/0047.pdf"
venue: "Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence"
year: 2023
pages: "418-426"
track: "Main Track"
keywords:
  - "AI Ethics, Trust, Fairness: ETF: Moral decision making"
  - "Knowledge Representation and Reasoning: KRR: Knowledge representation languages"
  - "Agent-based and Multi-agent Systems: MAS: Normative systems"
---

# Moral Planning Agents with LTL Values

Umberto Grandi, Emiliano Lorini, Timothy Parker

*Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence*, pages 418-426. DOI: [10.24963/ijcai.2023/47](https://doi.org/10.24963/ijcai.2023/47)

## Abstract

A moral planning agent (MPA) seeks to compare two plans or compute an optimal plan in an interactive setting with other agents, where relative ideality and optimality of plans are defined with respect to a prioritized value base. We model MPAs whose values are expressed by formulas of linear temporal logic (LTL) and define comparison for both joint plans and individual plans. We introduce different evaluation criteria for individual plans including an optimistic (risk-seeking) criterion, a pessimistic (risk-averse) one, and two criteria based on the use of anticipated responsibility. We provide complexity results for a variety of MPA problems.