It’s becoming increasingly apparent that one of the reasons why tech companies are so enthusiastic about shoving AI into every product and service is that they fundamentally do not understand…
I don’t see how the possibility it’s connected to some software system for profile building, is a reason to not care whether a language model is local only. The way things are worded here make it sound like this is just an intrinsic part of how LLMs work, but it just isn’t. The model still just does text prediction, any “memory” features are bolted on.
Because these are often sold with profile building features, for example, recall. Recall is sold as “local only” with profile building features. So it continues to be centralized pii that is a point of failure. As the quote says, as i said.
Even with Recall, a hypothetical non-local equivalent would be significantly worse. Whether Microsoft actually has your data or not obviously matters. Most conceivable software that uses local AI wouldn’t need any kind of profile building anyway, for instance that Firefox translation feature.
The thing that’s frustrating to me here is the lack of acknowledgement that the main privacy problem with AI services is sending all queries to some company’s server where they can do whatever they want with them.
What’s basically being said is, making an AI powered software local-only doesn’t make a difference and doesn’t matter. But that’s not true, and the arguments for that don’t seem coherent.
Software that is designed not to send your data over the internet doesn’t collect your data. That’s what local-only means. If it does send your data over the internet, then it isn’t local-only. How is it still happening?
But the company hasn’t collected it, because it doesn’t have it. Your computer has it. So long as it stays on your computer, it cannot harm your privacy. That’s why there is such a big difference here; an actual massive loss of privacy that is guaranteed to be combined with everyone else’s data and used against you, vs a potential risk of loss of privacy from someone gaining unauthorized access to your computer.
I don’t see how the possibility it’s connected to some software system for profile building, is a reason to not care whether a language model is local only. The way things are worded here make it sound like this is just an intrinsic part of how LLMs work, but it just isn’t. The model still just does text prediction, any “memory” features are bolted on.
Because these are often sold with profile building features, for example, recall. Recall is sold as “local only” with profile building features. So it continues to be centralized pii that is a point of failure. As the quote says, as i said.
Even with Recall, a hypothetical non-local equivalent would be significantly worse. Whether Microsoft actually has your data or not obviously matters. Most conceivable software that uses local AI wouldn’t need any kind of profile building anyway, for instance that Firefox translation feature.
The thing that’s frustrating to me here is the lack of acknowledgement that the main privacy problem with AI services is sending all queries to some company’s server where they can do whatever they want with them.
why do you care that someone didnt say it was worse enough? “x is a problem, if y is true then z is a problem” -> “why didnt you talk about x”
silly.
What’s basically being said is, making an AI powered software local-only doesn’t make a difference and doesn’t matter. But that’s not true, and the arguments for that don’t seem coherent.
the point is that making it local-only is not significantly better. it does not solve a major problem.
So you don’t think collection of user data is a meaningful privacy problem here? How does that work?
it is, and that is still happening.
Software that is designed not to send your data over the internet doesn’t collect your data. That’s what local-only means. If it does send your data over the internet, then it isn’t local-only. How is it still happening?
it does. it locally aggregates, collects data about what you do on your computer across the days and weeks.
But the company hasn’t collected it, because it doesn’t have it. Your computer has it. So long as it stays on your computer, it cannot harm your privacy. That’s why there is such a big difference here; an actual massive loss of privacy that is guaranteed to be combined with everyone else’s data and used against you, vs a potential risk of loss of privacy from someone gaining unauthorized access to your computer.