{"id":23721,"date":"2023-03-30T02:54:09","date_gmt":"2023-03-30T09:54:09","guid":{"rendered":"https:\/\/www.privateinternetaccess.com\/blog\/?p=23721"},"modified":"2024-01-23T23:39:29","modified_gmt":"2024-01-24T07:39:29","slug":"ai-chat-threat-to-privacy","status":"publish","type":"post","link":"https:\/\/www.privateinternetaccess.com\/blog\/ai-chat-threat-to-privacy\/","title":{"rendered":"AI-Based Chat is Coming for Your Privacy: Should We Pause Development of Large Language Models?"},"content":{"rendered":"\n

Back in February, we noted on PIA blog that the growing excitement about large language models (LLMs), for example in the form of ChatGPT<\/a>, overlooked the serious privacy dangers<\/a> they brought with them. In the space of a couple of months, the technology in this sector has moved on at a phenomenal pace: we saw the release of GPT-4<\/a>, Google\u2019s Bard<\/a>, and Baidu\u2019s Ernie<\/a>. <\/p>\n\n\n\n

As the impact of LLMs becomes clearer, people are starting to wake up to the wide range of problems they create, including for privacy. Perhaps the most dramatic manifestation of concerns surrounding generative AI is an open letter<\/a> from a range of well-known figures, in which they call for:<\/p>\n\n\n\n

\n

all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4. This pause should be public and verifiable, and include all key actors. If such a pause cannot be enacted quickly, governments should step in and institute a moratorium.<\/p>\n<\/blockquote>\n\n\n\n

Whether the criticisms of today\u2019s AI systems are valid or not, there seems little likelihood that any kind of moratorium on training LLMs will be brought in. There is simply too much hype, and too much venture capital being poured into it. However, the admittedly exciting technological advances we are seeing on a weekly, sometimes daily, basis also mean that addressing the safety issues is becoming more urgent.<\/p>\n\n\n\n

It\u2019s Not Too Late for AI Safety <\/h2>\n\n\n\n

There are already startups that aim to help deal with the problems of LLMs. For example, Anthropic<\/a> describes itself as an \u201cAI safety and research company,\u201d which aims to \u201cbuild large-scale experimental infrastructure to explore and improve the safety properties of computationally intensive AI models.\u201d It has put together a lengthy but approachable introduction to its core views on AI safety<\/a>. Anthropic\u2019s central concern is the following:<\/p>\n\n\n\n

\n

no one knows how to train very powerful AI systems to be robustly helpful, honest, and harmless. Furthermore, rapid AI progress will be disruptive to society and may trigger competitive races that could lead corporations or nations to deploy untrustworthy AI systems. The results of this could be catastrophic, either because AI systems strategically pursue dangerous goals, or because these systems make more innocent mistakes in high-stakes situations.<\/p>\n<\/blockquote>\n\n\n\n

Alongside research into these issues, Anthropic also offers what it terms a \u201cnext-generation assistant\u201d called Claude<\/a>. This takes basic chat systems like ChatGPT or Bard and hones them for a business context. According to the company, \u201cClaude can be a delightful company representative, a research assistant, a creative partner, a task automator, and more. Personality, tone, and behavior can all be customized to your needs.\u201d One of its key features is that it can engage in \u201crelevant, naturalistic back-and-forth conversation\u201d.<\/p>\n\n\n\n

The more naturalistic these AI assistants become, the more useful they are likely to be within a company, both as tools for employees, and to help with customer service. But there are major privacy concerns for both applications. Algorithms may act as perfect, tireless assistants for employees, but in the course of their operation they will be constantly gathering information about what staff are doing. <\/p>\n\n\n\n

AIs Relentlessly Collect A Lot of (Private) Data<\/h2>\n\n\n\n

The conversational nature of the AI assistant means that people using them are likely to be less guarded in what information they reveal. <\/p>\n\n\n\n

Moreover, the ability of AI systems to store and cross-reference that data \u2013 for example, comparing it with what people have said in the past, or with what other employees are doing \u2013 makes it a powerful tool for management to monitor every detail of employees\u2019 activities, productivity, and even personal opinions. Such a capability will be particularly attractive for companies that have people working for them remotely.<\/p>\n\n\n\n

Similarly, placing AI chat systems in the customer service roles will allow companies to gather and store significant quantities of data about people\u2019s views and personal details. AI chat will never tire, never deviate from the corporate script, and it can be programmed to ask questions that reveal details of people\u2019s lives at suitable points in the conversation. The \u201cnaturalistic back-and-forth\u201d of the chat that Anthropic\u2019s system offers is again likely to encourage customers to open up about their concerns and beliefs. Anthropic is not the only company offering this kind of service. Another is Character.ai<\/a>:<\/p>\n\n\n\n

\n

We understand the importance of providing an AI that truly feels like your own, and that\u2019s why our AI is customizable. From personality to values, you can customize your AI to suit your needs and preferences. Whether you want a sympathetic ear or an analytical problem-solver, there\u2019s an AI at Character.AI that\u2019s right for you. And if customization isn\u2019t your thing, we have a community of creators who\u2019ve already built over 1 million AI Characters for you to choose from.<\/p>\n<\/blockquote>\n\n\n

\n
\"Image
Character.ai Elon does have some Elon energy.<\/figcaption><\/figure>\n<\/div>\n\n\n

The range of those million AI Characters<\/a> is extremely wide, embracing major categories such as Helpers, Games, Movies and TV, Discussion, Politics, Books and Famous People to name just a few. Each of the AI chat options within those categories is designed to have its own particular feel. <\/p>\n\n\n\n

It is easy to imagine fans getting carried away chatting to these AI channels. According to the service\u2019s statistics, many popular AI chat options have already received millions of messages. The company claims that \u201cActive users spend on average over 2 hours daily interacting with our AI.\u201d The more users engage with these AI characters, the more likely they are to reveal personal views and lives. <\/p>\n\n\n\n

AI-Based Chat Could Soon Read Your Emotions<\/h2>\n\n\n\n

All of this personal data can be captured, stored and then fed into the AI system itself, with evident risks to the people involved.<\/p>\n\n\n\n

Other AI advances with implications for privacy are in the pipeline. A paper on arXiv reports on work to use LLMs to analyze non-verbal signals<\/a> that accompany human conversations \u2013 things like body gestures and facial expressions. AI systems can be taught to \u201cread\u201d these in order to gain valuable information about the state of mind of the person speaking. <\/p>\n\n\n\n

It\u2019s only a matter of time before non-verbal analysis is added to online chat systems so that AI-generated avatars can interact with humans during video calls, understand people beyond what they say, and even use their non-verbal cues to subtly influence the person they are talking to.<\/p>\n\n\n\n

The pace of change in the area of LLMs is such that some have called for a new field of \u201cdigital minds research<\/a>\u201d and the recognition of the rights of advanced, possibly sentient, AIs, including, presumably, the right to privacy.<\/p>\n\n\n\n