Proceedings

IC3-Evolve: Proof-/Witness-Gated Offline LLM-Driven Heuristic Evolution for IC3 Hardware Model Checking

Download BibTeX Cite

Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. Main Track. Pages 271-278.

https://doi.org/10.24963/ijcai.2026/31

Abstract

IC3, also known as property-directed reachability (PDR), is a commonly-used algorithm for hardware safety model checking. It checks if a state transition system complies with a given safety property. IC3 either returns UNSAFE (indicating property violation) with a counterexample trace, or SAFE with a checkable inductive invariant as the proof to safety. In practice, the performance of IC3 is dominated by a large web of interacting heuristics and implementation choices, making manual tuning costly, brittle, and hard to reproduce.

This paper presents IC3-Evolve, an automated offline code-evolution framework that utilizes an LLM to propose small, slot-restricted and auditable patches to an IC3 implementation. Crucially, every candidate patch is admitted only through proof-/witness-gated validation: SAFE runs must emit a certificate that is independently checked, and UNSAFE runs must emit a replayable counterexample trace, preventing unsound edits from being deployed. Since the LLM is used only offline, the deployed artifact is a standalone evolved checker with zero ML/LLM inference overhead and no runtime model dependency. We evolve on the public hardware model checking competition (HWMCC) benchmark and evaluate the generalizability on unseen public and industrial model checking benchmarks, showing that IC3-Evolve can reliably discover practical heuristic improvements under strict correctness gates.

  1. [Biere et al., 2024] Armin Biere, Tobias Faller, Katalin Fazekas, Mathias Fleury, Nils Froleyks, and Florian Pol- litt. CaDiCaL 2.0. In Arie Gurfinkel and Vijay Ganesh, editors, Computer Aided Verification -36th International Conference, CAV 2024, Montreal, QC, Canada, July 24- 27, 2024, Proceedings, Part I, volume 14681 of Lec- ture Notes in Computer Science, pages 133-152. Springer, 2024.
  2. [Biere, 2014] Armin Biere. Aiger and-inverter-graph library and utilities (incl. aigsim). https://github.com/arminbiere/ aiger, 2014. Link
  3. [Bradley, 2011] Aaron R. Bradley. Sat-based model check- ing without unrolling. In Ranjit Jhala and David Schmidt, editors, Verification, Model Checking, and Abstract Inter- pretation, pages 70-87, Berlin, Heidelberg, 2011. Springer Berlin Heidelberg.
  4. [Bradley, 2013] Aaron R. Bradley. IC3ref: Ic3 reference im- plementation. https://github.com/arbrad/IC3ref, 2013. Link
  5. [Brayton and Mishchenko, 2010] Robert Brayton and Alan Mishchenko. Abc: An academic industrial-strength ver- ification tool. In International Conference on Computer Aided Verification, pages 24-40. Springer, 2010.
  6. [Eén et al., 2011] Niklas Eén, Alan Mishchenko, and Robert Brayton. Efficient implementation of property directed reachability. In 2011 Formal Methods in Computer-Aided Design (FMCAD), pages 125-134. IEEE, 2011.
  7. [Hu et al., 2023] Guangyu Hu, Wei Zhang, and Hongce Zhang. Neuropdr: Integrating neural networks in the pdr algorithm for hardware model checking. In 2023 ACM/IEEE 5th Workshop on Machine Learning for CAD (MLCAD), pages 1-6. IEEE, 2023.
  8. [Hu et al., 2024] Guangyu Hu, Jianheng Tang, Changyuan Yu, Wei Zhang, and Hongce Zhang. Deepic3: Guiding ic3 algorithms by graph neural network clause prediction. In 2024 29th Asia and South Pacific Design Automation Conference (ASP-DAC), pages 262-268. IEEE, 2024. [hwm, 2024] HWMCC 2024: Hardware model checking competition 2024 (results). https://hwmcc.github.io/2024/, 2024. Link
  9. [hwm, 2025a] HWMCC 2025: Hardware model checking competition 2025 (results). https://hwmcc.github.io/2025/, 2025. Link
  10. [hwm, 2025b] HWMCC: Hardware model checking compe- tition. https://hwmcc.github.io/, 2025. Link
  11. [Janßen et al., 2024] Christian Janßen, Cedric Richter, and Heike Wehrheim. Can chatgpt support software veri- fication? In International Conference on Fundamen- tal Approaches to Software Engineering, pages 266-279.
  12. [Le et al., 2021] Nham Le, Xujie Si, and Arie Gurfinkel. Data-driven optimization of inductive generalization. In FMCAD, pages 86-95, 2021.
  13. [Novikov et al., 2025] Alexander Novikov, Ngân Vũ, Mar- vin Eisenberger, Emilien Dupont, Po-Sen Huang, Adam Zsolt Wagner, Sergey Shirobokov, Borislav Ko- zlovskii, Francisco JR Ruiz, Abbas Mehrabian, et al. Al- phaevolve: A coding agent for scientific and algorithmic discovery. arXiv preprint arXiv:2506.13131, 2025.
  14. [OpenAI, 2025] OpenAI. Addendum to gpt-5 system card: Gpt-5-codex, 2025.
  15. [Pirzada et al., 2024] Muhammad AA Pirzada, Giles Reger, Ahmed Bhayat, and Lucas C Cordeiro. Llm-generated invariants for bounded model checking without loop un- rolling. In Proceedings of the 39th IEEE/ACM Interna- tional Conference on Automated Software Engineering, pages 1395-1407, 2024.
  16. [Su et al., 2024] Yuheng Su, Qiusong Yang, and Yiwei Ci. Predicting lemmas in generalization of ic3. In Proceed- ings of the 61st ACM/IEEE Design Automation Confer- ence, DAC '24, New York, NY, USA, 2024. Association for Computing Machinery.
  17. [Su et al., 2025a] Yuheng Su, Qiusong Yang, Yiwei Ci, Tian- jun Bu, and Ziyu Huang. The ric3 hardware model checker, 2025.
  18. [Su et al., 2025b] Yuheng Su, Qiusong Yang, Yiwei Ci, Yingcheng Li, Tianjun Bu, and Ziyu Huang. Deeply opti- mizing the sat solver for the ic3 algorithm, 2025.
  19. [Sun et al., 2024] Yiwen Sun, Furong Ye, Xianyin Zhang, Shiyu Huang, Bingzhen Zhang, Ke Wei, and Shaowei Cai. Autosat: Automatically optimize sat solvers via large lan- guage models. arXiv preprint arXiv:2402.10705, 2024.
  20. [Wu et al., 2024] Guangyuan Wu, Weining Cao, Yuan Yao, Hengfeng Wei, Taolue Chen, and Xiaoxing Ma. Llm meets bounded model checking: Neuro-symbolic loop invariant inference. In Proceedings of the 39th IEEE/ACM Inter- national Conference on Automated Software Engineering, pages 406-417, 2024.
  21. [Yu et al., 2021] Emily Yu, Armin Biere, and Keijo Hel- janko. Progress in certifying hardware model checking results. In Alexandra Silva and K. Rustan M. Leino, edi- tors, Computer Aided Verification, pages 363-386, Cham, 2021. Springer International Publishing.
  22. [Yu et al., 2025] Cunxi Yu, Rongjian Liang, Chia-Tung Ho, and Haoxing Ren. Autonomous code evolution meets np- completeness. arXiv preprint arXiv:2509.07367, 2025.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards