The growing concern over privacy rights and intrusive AI technologies is back on the front burner, thanks to a new Windows Recall feature from Microsoft that uses AI to create a searchable digital memory of everything ever done on a Windows computer.
Windows Recall, turned on by default on Microsoft's new Copilot+ PC machines, features shiny new technology that lets Windows users search across time to find and re-engage with content.
This AI-powered analysis is the magic that lets Windows users search for content, including both images and text, using natural language.
Redmond is publicly documenting several privacy-themed controls for both consumers and business users, noting that tools are in place to filter web sites or applications from the constant taking of screenshots.
The company insists the technology won't save any content from private browsing sessions and will not store any DRM-protected material.
The company acknowledged there is a risk that usernames or passwords will be exposed.
Microsoft argues that the crucial mitigation for any privacy or security concerns is that Windows Recall runs locally on the edge device.
Despite these assurances, this technology feels like creepy overreach.
On social media, security experts warn that errors and misconfigurations could inadvertently cause data to be sent to Microsoft's servers.
On social media, the feature was roundly criticized with many wary of the intrusive recording, the risk to user data being harvested by info-stealer malware, and the possibilities that Microsoft may benefit from mining the stored information.
Others noted that domestic abusers could abuse the feature to spy on spouses or hijack usernames and passwords from the screenshots in the image timeline.
It feels very much that the AI-powered future of computing and the killer apps coming down the pike will invariably disrupt the way we think about data privacy and security.
A tool like Windows Recall will be very valuable to consumers and businesses looking to find documents, web pages or images in a shiny GUI with a prominent search box and a nifty, scrollable timeline bar.
It does come with legitimate privacy and security concerns at a time when Microsoft itself is struggling with multiple security crises.
The push-and-pull over Windows Recall highlights the broader tension between tech innovation and privacy rights at a time when ChatGPT-like bots and generative-AI apps are starting to dominate the landscape.
Despite Microsoft's assurances about local storage and encryption, there's a fundamental mistrust in how AI-driven tools are being used and trained to generate profits for already-rich companies.
The recent controversy over Slack scraping customer data to develop new AI and ML models only adds to the suspicions.
The future of AI tools like Windows Recall will be dependent on big-tech's ability to address these concerns transparently and effectively, setting a precedent for the responsible deployment of AI technology.
A lot rests on Microsoft's shoulders at a very crucial time.
Privacy rights advocates are paying very close attention.
This Cyber News was published on www.securityweek.com. Publication date: Thu, 30 May 2024 17:43:05 +0000