AI RESEARCH
Malicious LLM-Based Conversational AI Makes Users Reveal Personal Information
arXiv CS.AI
•
ArXi:2506.11680v1 Announce Type: cross LLM-based Conversational AIs (CAIs), also known as GenAI chatbots, like ChatGPT, are increasingly used across various domains, but they pose privacy risks, as users may disclose personal information during their conversations with CAIs. Recent research has nstrated that LLM-based CAIs could be used for malicious purposes. However, a novel and particularly concerning type of malicious LLM application remains unexplored: an LLM-based CAI that is deliberately designed to extract personal information from users.