Google Assistant's human workers listen to customer conversations
Google contractors regularly listen to and review some recordings of what customers say to artificial-intelligence system Google Assistant, via their phone or through smart speakers such as the Google Home. The issue raises privacy concerns about digital assistants, which are increasingly used in U.S. households.
The company acknowledged that humans can access those recordings after some of its Dutch language audio snippets were leaked. Google product manager David Monsees acknowledged the leak in a blog post Thursday, and said the company is investigating the breach.
"We are conducting a full review of our safeguards in this space to prevent misconduct like this from happening again," he wrote.
Monsees added that Google works with language experts who listen to a small portion of the recordings to help the company "understand the nuances and accents of a specific language."
Personal conversations
More than 1,000 recordings were obtained by Belgian broadcaster VRT NWS, which noted in a story that some contained sensitive personal conversations — as well as information that identified the person speaking. Google says no user account information is associated with the recordings, and reviewers are instructed not to transcribe background conversations.
But VRT reporters could hear spoken home addresses in some of the recordings, and were able to track down the speakers. Some of these conversations were not directed at Assistant and happened either as background noise or as a mistaken recording when Assistant thought it was being spoken to, but wasn't.
Google says contractors listen to recordings to better understand language patterns and accents. Its user terms confirm recordings may be used by the company, stating Assistant "records your voice and audio on Google services to improve speech recognition."
Monsees wrote that the language review about 0.2 percent of recorded audio snippets.
"Audio snippets are not associated with user accounts as part of the review process, and reviewers are directed not to transcribe background conversations or other noises, and only to transcribe snippets that are directed to Google," he noted.
Google's terms
Google's terms don't explicitly say that people review the recordings, but do state that data could be analyzed as the company updates services or create new features.
The company acknowledged earlier this year that its reviewers listen to anonymous recordings in response to a Bloomberg report revealing that Amazon's Alexa also uses contractors to listen to recordings. Amazon confirmed the report.
Google's recording feature can be turned off, but doing so means Assistant loses some of its personalized touch. People who turn off the recording feature lose the ability for the Assistant to recognize individual voices and learn your voice pattern.
Assistant recording is actually turned off by default — but the technology prompts users to turn on recording and other tools in order to get personalized features.
Google Assistant is available on more than 1 billion devices, including smartphones and smart speakers. It's made quite a dent in the smart speaker market — still the primary place where people use voice technology — but still trails behind Amazon.