CORE: Towards Scalable and Efficient Causal Discovery with Reinforcement Learning

التفاصيل البيبلوغرافية
العنوان: CORE: Towards Scalable and Efficient Causal Discovery with Reinforcement Learning
المؤلفون: Sauter, Andreas W. M., Botteghi, Nicolò, Acar, Erman, Plaat, Aske
سنة النشر: 2024
المجموعة: Computer Science
مصطلحات موضوعية: Computer Science - Machine Learning, Computer Science - Artificial Intelligence, I.2.6, I.2.8
الوصف: Causal discovery is the challenging task of inferring causal structure from data. Motivated by Pearl's Causal Hierarchy (PCH), which tells us that passive observations alone are not enough to distinguish correlation from causation, there has been a recent push to incorporate interventions into machine learning research. Reinforcement learning provides a convenient framework for such an active approach to learning. This paper presents CORE, a deep reinforcement learning-based approach for causal discovery and intervention planning. CORE learns to sequentially reconstruct causal graphs from data while learning to perform informative interventions. Our results demonstrate that CORE generalizes to unseen graphs and efficiently uncovers causal structures. Furthermore, CORE scales to larger graphs with up to 10 variables and outperforms existing approaches in structure estimation accuracy and sample efficiency. All relevant code and supplementary material can be found at https://github.com/sa-and/CORETest
Comment: To be published In Proc. of the 23rd International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2024), Auckland, New Zealand, May 6 - 10, 2024, IFAAMAS
نوع الوثيقة: Working Paper
الوصول الحر: http://arxiv.org/abs/2401.16974Test
رقم الانضمام: edsarx.2401.16974
قاعدة البيانات: arXiv