{"type":"ScholarlyArticle","title":"Data Ownership and Privacy in Personalized AI Models in Assistive Healthcare","authors":[{"name":"Boris Debic","slug":"boris-debic","given":"Boris","family":"Debic","affiliation":"Zagreb School of Economics and Management , Zagreb , Croatia.; Google Inc. Mountain View , CA , US."},{"name":"Luka Medvidovic","slug":"luka-medvidovic","given":"Luka","family":"Medvidovic","affiliation":"Zagreb School of Economics and Management , Zagreb , Croatia."}],"abstract":"The use of personalized artificial intelligence (AI) models in assistive healthcare presents a number of ethical and legal challenges, they are examined in this paper. We look at a number of situations in which AI models have close interactions with persons under care. In particular we are interested in the question of model and data ownership, privacy, and ethical implications. The paper also surveys the existing regulatory environment, including the US Congress's legislative initiatives and the US Federal Trade Commission's examination of AI. Additionally, it covers AI strategies such as modular AI and discusses possible solutions to the issues described. We present an overview of the current outstanding problems and with this work offer a researched and organized contribution for a public discussion of responsible application of AI in this field of healthcare. Our selection of topics is guided by keeping in mind the key stakeholders: technology providers, healthcare or care providers, care beneficiaries and their families.","doi":"10.24963/ijcai.2024/868","url":"https://ijcai.org/proceedings/2024/868","pdf":"https://ijcai.org/proceedings/2024/0868.pdf","markdown":"https://ijcai.org/proceedings/2024/868.md","bibtex":"https://ijcai.org/proceedings/2024/bibtex/868","volume":{"slug":"2024","title":"Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2024","url":"https://ijcai.org/proceedings/2024/","year":2024,"location":"Jeju, Korea","dates":"3-9 August 2024","editors":"Kate Larson","isbn":"978-1-956792-04-1","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2024"},"section":"Human-Centred AI","track":"Human-Centred AI","number":868,"pages":{"first":7842,"last":7849},"keywords":["Humans and AI: General","Multidisciplinary Topics and Applications: MTA: Health and medicine","AI Ethics, Trust, Fairness: ETF: AI and law, governance, regulation","Machine Learning: General"],"videos":[],"references":[{"position":1,"raw":"[Abatal and Korchi, 2023] A. Abatal and A. Korchi. Trans- forming healthcare systems with artificial intelligence: revolutionizing efficiency, quality, and patient care, 2023. https://doi.org/10.21203/rs.3.rs-3175341/v1.","title":"Transforming healthcare systems with artificial intelligence: revolutionizing efficiency, quality, and patient care","authors":"A Abatal, A Korchi","year":"2023","venue":null,"doi":"10.21203/rs.3.rs-3175341/v1","url":"https://doi.org/10.21203/rs.3.rs-3175341/v1","internal_url":null},{"position":2,"raw":"[Amedior, 2023] N. Amedior. Ethical implications of artificial intelligence in the healthcare sector. Ad- vances in Multidisciplinary and Scientific Research Jour- nal Publication, 2023. https://doi.org/10.22624/aims- /accrabespoke2023p1.","title":"Ethical implications of artificial intelligence in the healthcare sector","authors":"N Amedior","year":"2023","venue":"Advances in Multidisciplinary and Scientific Research Journal Publication","doi":"10.22624/aims-/accrabespoke2023p1","url":"https://doi.org/10.22624/aims-/accrabespoke2023p1","internal_url":null},{"position":3,"raw":"[Andtfolk et al., 2021a] M. Andtfolk, L. Nyholm, H. Eide, and L. Fagerström. Humanoid robots in the care of older persons: a scoping review. Assistive Technology, 34(5):518-526, 2021.","title":"Humanoid robots in the care of older persons: a scoping review","authors":"Andtfolk","year":"2021","venue":"Assistive Technology","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Andtfolk et al., 2021b] M. Andtfolk, L. Nyholm, H. Eide, A. Rauhala, and L. Fagerström. Attitudes toward the use of humanoid robots in healthcare-a cross-sectional study. Ai & Society, 37(4):1739-1748, 2021.","title":"Attitudes toward the use of humanoid robots in healthcare-a cross-sectional study","authors":"Andtfolk","year":"2021","venue":"Ai & Society","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"Arterys, nd] Arterys. Arterys. Online, n.d. https:// www.arterys.com.","title":"Arterys. Arterys","authors":"Arterys","year":null,"venue":null,"doi":null,"url":"https://www.arterys.com","internal_url":null},{"position":6,"raw":"BenevolentAI, nd] BenevolentAI. Benevolentai. Online, n.d. https://www.benevolent.com.","title":"BenevolentAI. Benevolentai","authors":"Benevolentai","year":null,"venue":null,"doi":null,"url":"https://www.benevolent.com","internal_url":null},{"position":7,"raw":"[Chikhaoui et al., 2022] E. Chikhaoui, A. Alajmi, and S. Marie-Sainte. Artificial intelligence applications in healthcare sector: ethical and legal challenges. Emerging Science Journal, 6(4):717-738, 2022.","title":"Artificial intelligence applications in healthcare sector: ethical and legal challenges","authors":"E Chikhaoui, A Alajmi, S Marie-Sainte","year":"2022","venue":"Emerging Science Journal","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"Cleerly, nd] Cleerly. Cleerly. Online, n.d. https:// cleerlyhealth.com.","title":"Cleerly. Cleerly","authors":"Cleerly","year":null,"venue":null,"doi":null,"url":"https://cleerlyhealth.com","internal_url":null},{"position":9,"raw":"[Dastin and Tong, 2023] J. Dastin and A. Tong. Ope- nai rolls out 'incognito mode' on chatgpt. Reuters, 2023. https://www.reuters.com/technology/openai-rolls- out-incognito-mode-chatgpt-2023-04-25/.","title":"Openai rolls out 'incognito mode' on chatgpt","authors":"J Dastin, A Tong","year":"2023","venue":null,"doi":null,"url":"https://www.reuters.com/technology/openai-rolls-out-incognito-mode-chatgpt-2023-04-25/","internal_url":null},{"position":10,"raw":"[Dwivedi and others, 2021] Y. Dwivedi et al. Artificial in- telligence (ai): multidisciplinary perspectives on emerging challenges, opportunities, and agenda for research, prac- tice and policy. International Journal of Information Man- agement, 57, 2021.","title":"Artificial intelligence (ai): multidisciplinary perspectives on emerging challenges, opportunities, and agenda for research, practice and policy","authors":"Y Dwivedi","year":"2021","venue":"International Journal of Information Management","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Eshwar, 2023] M. Eshwar. Exploring the potential of artifi- cial intelligence in healthcare: possibilities and challenges. International Scientific Journal of Engineering and Man- agement, 2023. https://doi.org/10.55041/isjem00408. [Genomics, 2023] Deep Genomics. Deep genomics: The discovery platform for genetic medicine. Online, 2023. https://www.deepgenomics.com/.","title":"Exploring the potential of artificial intelligence in healthcare: possibilities and challenges","authors":"M Eshwar","year":"2023","venue":"Genomics. Deep genomics: The discovery platform for genetic medicine","doi":"10.55041/isjem00408","url":"https://www.deepgenomics.com/","internal_url":null},{"position":12,"raw":"[Giorgi et al., 2022] I.","title":null,"authors":"Giorgi","year":"2022","venue":null,"doi":null,"url":null,"internal_url":null},{"position":13,"raw":"Giorgi, F. Tirotto, O. Hagen, F. Aider, M. Gianni, M. Palomino, and G. Masala. Friendly but faulty: a pilot study on the perceived trust of older adults in a social robot. IEEE Access, 10:92084-92096, 2022.","title":"Friendly but faulty: a pilot study on the perceived trust of older adults in a social robot","authors":"F Giorgi, O Tirotto, F Hagen, M Aider, M Gianni, G Palomino, Masala","year":"2022","venue":"IEEE Access","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Grimm and Chiasson, 2014] C. Grimm and S. Chiasson. Survey on the fate of digital footprints after death, 2014. https://doi.org/10.14722/usec.2014.23049.","title":"Survey on the fate of digital footprints after death","authors":"C Grimm, S Chiasson","year":"2014","venue":null,"doi":"10.14722/usec.2014.23049","url":"https://doi.org/10.14722/usec.2014.23049","internal_url":null},{"position":15,"raw":"[Harbinja, 2017] E. Harbinja. Post-mortem privacy 2.0: the- ory, law, and technology. International Review of Law Computers & Technology, 31(1):26-42, 2017.","title":"Post-mortem privacy 2.0: theory, law, and technology","authors":"E Harbinja","year":"2017","venue":"International Review of Law Computers & Technology","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Hub, 2023] Singularity Hub. Ai agents with 'multiple selves' learn to adapt quickly in a changing world. Online, 2023. https://singularityhub.com/2023/07/11/ai-agents- with-multiple-selves-can-rapidly-adapt-to-a-changing- world/.","title":"Singularity Hub. Ai agents with 'multiple selves' learn to adapt quickly in a changing world","authors":"Hub","year":"2023","venue":null,"doi":null,"url":"https://singularityhub.com/2023/07/11/ai-agents-with-multiple-selves-can-rapidly-adapt-to-a-changing-world/","internal_url":null},{"position":17,"raw":"InformAI, nd] InformAI. Informai. Online, n.d. https:// www.informai.com. [Insitro, nd] Insitro. Insitro. Online, n.d. https:// www.insitro.com.","title":"InformAI. Informai","authors":"Informai","year":null,"venue":null,"doi":null,"url":"https://www.insitro.com","internal_url":null},{"position":18,"raw":"[Jiang and others, 2017] F. Jiang et al. Artificial intelligence in healthcare: past, present and future. Stroke and Vascular Neurology, 2(4):230-243, 2017.","title":"Artificial intelligence in healthcare: past, present and future","authors":"F Jiang","year":"2017","venue":"Stroke and Vascular Neurology","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Jung et al., 2022] S. Jung, S. Ahn, J. Ha, and S. Bahn. A study on the effectiveness of it application education for older adults by interaction method of humanoid robots. In- ternational Journal of Environmental Research and Public Health, 19(17):10988, 2022.","title":"A study on the effectiveness of it application education for older adults by interaction method of humanoid robots","authors":"S Jung, S Ahn, J Ha, S Bahn","year":"2022","venue":"International Journal of Environmental Research and Public Health","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Kemppainen et al., 2022] L. Kemppainen, M. Pikkarainen, T. Koivumäki, and Y. Xu. Drivers for platform business model innovation: individuals in control over their per- sonal data. Journal of Innovation Management, 10(3):46- 74, 2022.","title":"Drivers for platform business model innovation: individuals in control over their personal data","authors":"L Kemppainen, M Pikkarainen, T Koivumäki, Y Xu","year":"2022","venue":"Journal of Innovation Management","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Khan et al., 2023] B. Khan, H. Fatima, A. Qureshi, S. Ku- mar, A. Hanan, J. Hussain, and S. Abdullah. Drawbacks of artificial intelligence and their potential solutions in the healthcare sector. Biomedical Materials and Devices, 2023.","title":"Drawbacks of artificial intelligence and their potential solutions in the healthcare sector","authors":"B Khan, H Fatima, A Qureshi, S Kumar, A Hanan, J Hussain, S Abdullah","year":"2023","venue":"Biomedical Materials and Devices","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Lebcir et al., 2021] R. Lebcir, I. Vlaev, R. Atun, and M. Cubric. Stakeholders' views on the organizational factors affecting application of artificial intelligence in healthcare: a scoping review protocol. BMJ Open, 11(3):e044074, 2021.","title":"Stakeholders' views on the organizational factors affecting application of artificial intelligence in healthcare: a scoping review protocol","authors":"R Lebcir, I Vlaev, R Atun, M Cubric","year":"2021","venue":"BMJ Open","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Liu et al., 2023] Z. Liu, E. Gan, and M. Tegmark. Seeing is believing: Brain-inspired modular training for mechanistic interpretability. arXiv preprint arXiv:2305.08746, 2023. https://arxiv.org/abs/2305.08746.","title":"Seeing is believing: Brain-inspired modular training for mechanistic interpretability","authors":"Z Liu, E Gan, M Tegmark","year":"2023","venue":null,"doi":null,"url":"https://arxiv.org/abs/2305.08746","internal_url":null},{"position":24,"raw":"[Mackinnon, 2022] K. Mackinnon. Critical care for the early web: ethical digital methods for archived youth data. Jour- nal of Information Communication and Ethics in Society, 20(3):349-361, 2022.","title":"Critical care for the early web: ethical digital methods for archived youth data","authors":"K Mackinnon","year":"2022","venue":"Journal of Information Communication and Ethics in Society","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[McKinsey Global Institute, 2018] McKinsey Global Insti- tute. Assessing the economic impact of artificial in- telligence. ITU Trends, Issue Paper No.1, Septem- ber 2018. https://www.itu.int/en/ITU-D/Statistics/Pages/ publications/misr2018.aspx.","title":"Assessing the economic impact of artificial intelligence","authors":null,"year":"2018","venue":null,"doi":null,"url":"https://www.itu.int/en/ITU-D/Statistics/Pages/publications/misr2018.aspx","internal_url":null},{"position":26,"raw":"[McLennan and others, 2022] S. McLennan et al. Embedded ethics: a proposal for integrating ethics into the develop- ment of medical ai. BMC Medical Ethics, 23(1), 2022.","title":"Embedded ethics: a proposal for integrating ethics into the development of medical ai","authors":"S Mclennan","year":"2022","venue":"BMC Medical Ethics","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Mittelstadt, 2019] B. Mittelstadt. Principles alone can- not guarantee ethical ai. Nature Machine Intelligence, 1(11):501-507, 2019.","title":"Principles alone cannot guarantee ethical ai","authors":"B Mittelstadt","year":"2019","venue":"Nature Machine Intelligence","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"B. Murdoch. Privacy and artificial intelli- gence: challenges for protecting health information in a new era. BMC Medical Ethics, 22(1), 2021.","title":"Privacy and artificial intelligence: challenges for protecting health information in a new era","authors":"B Murdoch","year":"2021","venue":"BMC Medical Ethics","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Nakagawa and Orita, 2022] H. Nakagawa and A. Orita. Us- ing deceased people's personal data. Ai & Society, 2022.","title":"Using deceased people's personal data","authors":"H Nakagawa, A Orita","year":"2022","venue":null,"doi":null,"url":null,"internal_url":null},{"position":30,"raw":"Newswire, nd] PR Newswire. Ubie, japanese healthtech startup. Online, n.d. https://www.prnewswire.com.","title":"PR Newswire. Ubie, japanese healthtech startup","authors":null,"year":null,"venue":null,"doi":null,"url":"https://www.prnewswire.com","internal_url":null},{"position":31,"raw":"[Owkin, 2023] Owkin. Owkin: Transforming discovery in healthcare with ai and federated learning. Online, 2023. https://owkin.com/.","title":"Owkin. Owkin: Transforming discovery in healthcare with ai and federated learning","authors":"Owkin","year":"2023","venue":null,"doi":null,"url":"https://owkin.com/","internal_url":null},{"position":32,"raw":"[Pasricha, 2023] S. Pasricha. Ai ethics in smart health- care. IEEE Consumer Electronics Magazine, 12(4):12-20, 2023.","title":"Ai ethics in smart healthcare","authors":"S Pasricha","year":"2023","venue":"IEEE Consumer Electronics Magazine","doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Prakash and others, 2022] S. Prakash et al. Ethical conun- drums in the application of artificial intelligence (ai) in healthcare-a scoping review of reviews. Journal of Per- sonalized Medicine, 12(11):1914, 2022.","title":"Ethical conundrums in the application of artificial intelligence (ai) in healthcare-a scoping review of reviews","authors":"S Prakash","year":"2022","venue":"Journal of Personalized Medicine","doi":null,"url":null,"internal_url":null},{"position":34,"raw":"[Racine et al., 2019] E. Racine, W. Boehlen, and M. Sample. Healthcare uses of artificial intelligence: challenges and opportunities for growth. Healthcare Management Forum, 32(5):272-275, 2019.","title":"Healthcare uses of artificial intelligence: challenges and opportunities for growth","authors":"E Racine, W Boehlen, M Sample","year":"2019","venue":"Healthcare Management Forum","doi":null,"url":null,"internal_url":null},{"position":35,"raw":"[Schwalbe and Wahl, 2020] N. Schwalbe and B. Wahl. Ar- tificial intelligence and the future of global health. The Lancet, 395(10236):1579-1586, 2020.","title":"Artificial intelligence and the future of global health","authors":"N Schwalbe, B Wahl","year":"2020","venue":"The Lancet","doi":null,"url":null,"internal_url":null},{"position":36,"raw":"[Segmed, 2023] Segmed. The fastest way to acquire medical data online. Online, 2023. https://www.segmed.ai/.","title":"Segmed. The fastest way to acquire medical data online","authors":"Segmed","year":"2023","venue":null,"doi":null,"url":"https://www.segmed.ai/","internal_url":null},{"position":37,"raw":"[Solanki et al., 2022] P. Solanki, J. Grundy, and W. Hus- sain. Operationalizing ethics in artificial intelligence for healthcare: a framework for ai developers. Ai and Ethics, 3(1):223-240, 2022.","title":"Operationalizing ethics in artificial intelligence for healthcare: a framework for ai developers","authors":"P Solanki, J Grundy, W Hussain","year":"2022","venue":"Ai and Ethics","doi":null,"url":null,"internal_url":null},{"position":38,"raw":"[Stypińska and Franke, 2023] J. Stypińska and A. Franke. Ai revolution in healthcare and medicine and the (re- )emergence of inequalities and disadvantages for ageing population. Frontiers in Sociology, 7, 2023.","title":"Ai revolution in healthcare and medicine and the (re-)emergence of inequalities and disadvantages for ageing population","authors":"J Stypińska, A Franke","year":"2023","venue":"Frontiers in Sociology","doi":null,"url":null,"internal_url":null},{"position":39,"raw":"[Sweeney, 2013] L. Sweeney. Discrimination in online ad delivery. Queue, 11(3):10-29, 2013.","title":"Discrimination in online ad delivery","authors":"L Sweeney","year":"2013","venue":"Queue","doi":null,"url":null,"internal_url":null},{"position":40,"raw":"[Syntegra, 2023] Syntegra. Transforming healthcare with synthetic data. Online, 2023. https://www.syntegra.io/. [TechCrunch, 2022] TechCrunch. Image-generating ai can copy and paste from training data, raising ip con- cerns, 2022. https://techcrunch.com/2022/10/07/image- generating-ai-can-copy-and-paste-from-training-data- raising-ip-concerns/.","title":"Syntegra. Transforming healthcare with synthetic data","authors":null,"year":"2022","venue":null,"doi":null,"url":"https://techcrunch.com/2022/10/07/image-generating-ai-can-copy-and-paste-from-training-data-raising-ip-concerns/","internal_url":null},{"position":41,"raw":"[TechCrunch, 2023] TechCrunch. Meta confirms ai 'off- switch' coming to facebook and instagram in europe, 2023. https://techcrunch.com/2023/08/22/meta-confirms- ai-off-switch-incoming-to-facebook-instagram-in- europe/.","title":"TechCrunch. Meta confirms ai 'offswitch' coming to facebook and instagram in europe","authors":null,"year":"2023","venue":null,"doi":null,"url":"https://techcrunch.com/2023/08/22/meta-confirms-ai-off-switch-incoming-to-facebook-instagram-in-europe/","internal_url":null},{"position":42,"raw":"[Tulsulkar et al., 2021] G. Tulsulkar, N. Mishra, N. Thal- mann, H. Lim, M. Lee, and S. Cheng. Can a humanoid social robot stimulate the interactivity of cognitively im- paired elderly? a thorough study based on computer vision methods. The Visual Computer, 37(12):3019-3038, 2021.","title":"Can a humanoid social robot stimulate the interactivity of cognitively impaired elderly? a thorough study based on computer vision methods","authors":"G Tulsulkar, N Mishra, N Thalmann, H Lim, M Lee, S Cheng","year":"2021","venue":"The Visual Computer","doi":null,"url":null,"internal_url":null},{"position":43,"raw":"[Wang et al., 2022] C. Wang, J. Zhang, N. Lassi, and X. Zhang. Privacy protection in using artificial intelligence for healthcare: Chinese regulation from a comparative per- spective. Healthcare, 10(10):1878, 2022.","title":"Privacy protection in using artificial intelligence for healthcare: Chinese regulation from a comparative perspective","authors":"C Wang, J Zhang, N Lassi, X Zhang","year":"2022","venue":"Healthcare","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}