Decision rules, which can provide good interpretability andflexibility for data mining tasks, have received very littleattention in the stream mining community so far. In this workwe introduce a new algorithm to learn rule sets, designed for open-ended data streams.The proposed algorithm is able to continuously learn compact ordered and unordered rule sets. The experimental evaluation shows competitive results in comparison with VFDT and C4.5rules.