{"id":24230,"date":"2023-05-11T03:04:04","date_gmt":"2023-05-11T10:04:04","guid":{"rendered":"https:\/\/www.privateinternetaccess.com\/blog\/?p=24230"},"modified":"2024-01-25T00:35:40","modified_gmt":"2024-01-25T08:35:40","slug":"chatbot-privacy-open-source","status":"publish","type":"post","link":"https:\/\/www.privateinternetaccess.com\/blog\/chatbot-privacy-open-source\/","title":{"rendered":"Chatbot Privacy Is Possible with Open Source Models, but Big Tech Might Not Like It"},"content":{"rendered":"\n

Back in February, PIA blog was one of the first to point out that chatbots might indeed be an exciting breakthrough for artificial intelligence (AI), but that they also represent a huge new threat to privacy<\/a>. And sure enough, a couple of months later, data protection authorities around the world started taking an interest and raising the alarm<\/a>. <\/p>\n\n\n\n

In the vanguard of this scrutiny was Italy\u2019s data protection agency, \u201cIl Garante per la protezione dei dati personali\u201d. It shut down the use of ChatGPT in the country precisely because of concerns that it violated the EU\u2019s General Data Protection Regulation (GDPR). It gave the company behind ChatGPT, OpenAI, a list of changes it wanted to see, and a deadline for making them.<\/p>\n\n\n\n

While OpenAI complied with the request, the bigger problem of proprietary chatbot systems logging your personal information remains. The best solution seems to be simple, yet potentially harmful to the biggest players in the field: open source chatbots.<\/p>\n\n\n\n

Can Proprietary AI Systems Actually Remove Your Personal Information?<\/h2>\n\n\n\n

Italy has rescinded its ban on ChatGPT after OpenAI modified how it operates<\/a>. The company agreed to give more information about how it processes personal data, and updated its sign-up page in Italy to require users to give their date of birth. This is designed to prevent those under 13 years old from using the system. <\/p>\n\n\n\n

OpenAI has also created a form<\/a> for those who wish to object to the processing of their personal data. But one of the requirements is that people need to provide evidence that their data is being used: <\/p>\n\n\n\n

\n

Please provide any relevant prompts that resulted in the model mentioning the data subject. To be able to properly address your requests, we need clear evidence that the model has knowledge of the data subject conditioned on the prompts.<\/p>\n\n\n\n

<\/p>\n<\/blockquote>\n\n\n\n

In other words, it\u2019s necessary to sign up to OpenAI in order to object to its processing, which seems unsatisfactory.<\/p>\n\n\n\n

It is not clear how completely <\/em>OpenAI can remove personal data even if it wants to. Its models do not store such data directly. Instead, the information is part of the vast set of training parameters. That means all kinds of personal information is \u201cbaked in\u201d to those models in a subtle, non-obvious way. There are no precedents for trying to delete specific personal data from these huge and inscrutable models, so it remains whether and to what extent it can be done.<\/p>\n\n\n\n

Fortunately, while data protection authorities around the world have been fretting about the privacy implications, a major technical development has taken place that could solve many of the problems they have been discovering. There are now open source chatbots and generative AI systems that are as powerful as commercial systems costing thousands of times more. Moreover, these new systems are extremely compact, as this blog post by Christopher S. Penn<\/a> explains:<\/p>\n\n\n\n

\n

There are even projects to put these models on your laptop as private chat instances, like the GPT4ALL software. This looks and runs like ChatGPT, but it\u2019s a desktop app that doesn\u2019t need an internet connection once it\u2019s set up and, critically, it does not share data outside your individual computer, ensuring privacy.<\/p>\n<\/blockquote>\n\n\n\n

His post has an excellent explanation of how this has been achieved, and the implications for protecting personal data:<\/p>\n\n\n\n

\n

Up until now, services like ChatGPT have sent your data to a third party company for use, which is why we\u2019ve said you should never, ever use them with sensitive information. Now, that\u2019s no longer the case \u2013 you can use GPT4ALL in complete privacy. It\u2019s the best of both worlds \u2013 the performance and capabilities of a service like ChatGPT with ironclad privacy because the data \u2013 your data \u2013 never leaves your computer. That makes it ideal for industries like finance, healthcare, government \u2013 any place where you wouldn\u2019t just want to hand over protected information willy nilly.<\/p>\n<\/blockquote>\n\n\n\n

Open-Source Chatbot Privacy Is Possible<\/h2>\n\n\n\n

Now that companies can run powerful chatbot systems on their own hardware, with no data sent to the outside world, it seems likely that a new tech sector producing highly-tailored solutions for business and general users could spring up. <\/p>\n\n\n\n

Locally-hosted AI chatbots will avoid many of the problems with popular solutions by limiting their functionality to very specific domains. That means they are unlikely to start producing wildly incorrect, irrelevant or even dangerous responses to queries. Best of all, there will be fewer privacy concerns because any personal data used for training these systems will not leave the company\u2019s premises (although there may still be important GDPR issues concerning user consent).<\/p>\n\n\n\n

This is great news for businesses and general users. But it does raise questions about today\u2019s leaders in the chatbot field \u2013 companies like OpenAI, Google and Microsoft \u2013 that are spending billions of dollars developing proprietary solutions. What seems to be a leaked internal Google document<\/a> shows that at least some within that company realize that they and others have a serious problem:<\/p>\n\n\n\n

\n

in the end, OpenAI doesn\u2019t matter. They are making the same mistakes we are in their posture relative to open source, and their ability to maintain an edge is necessarily in question. Open source alternatives can and will eventually eclipse them unless they change their stance.<\/p>\n<\/blockquote>\n\n\n\n

Although it is still early days, the rise of compact, powerful chatbot systems that are open source is perhaps the best tech development we could have hoped for. It makes it less likely that the nascent AI market will be owned by one giant company, and it will allow new startups based on open source code to be launched quickly. Moreover, the ability to run AI chatbots on corporate or even personal computers makes solving the major privacy issues that currently plague chatbots much easier than originally feared.<\/p>\n\n\n\n