Meta patented AI tech that constantly analyzes your voice and surroundings in order to detect your emotional state. Finally, exactly what we were all asking for: Meta being granted constant access to our offline lives.

As first caught by Patentlyze, a patent published on July 2 describes a system that records all the user’s “audible communications” and combines it with “contextual factors” like “time of day, location, user activity, or digital interaction.” Audio may be “transcribed, and an emotional-state machine learning model may interpret verbal and nonverbal cues to determine emotional indicators.”

In other words, the system listens to you and everything you do, combines it with other data, and feeds it all to a mood-predicting AI.

“The system increases the precision and reliability of emotional inference by aligning multimodal sensor inputs on synchronized timelines, which creates a novel data structure that supports richer emotional analysis,” reads the patent. “These combined features deliver a technical improvement in automated audio interpretation, enabling continuous emotional monitoring on everyday devices.”

According to the patent, the goal of this extraordinarily intrusive system would be to better tailor users’ workouts to their emotional state, as “personal trainers cannot provide the level of precision in guidance, such as correcting a pose and/or body movement,” as well as Meta’s imagined device could.

It’s not surprising to see Meta pitch this kind of surveillance technology as a fitness device. Health-tracking wearables have become wildly popular, despite the extraordinary amount of physical data about individual consumers they collect and store.

The key difference in Meta’s case, is that rather than crunch biological metrics, it’s an AI-powered fly-on-the-wall attempting to measure a person’s emotional state by listening in on the world around them, and possibly then connecting that information to all other available data.

“The AI assistant may listen to a user(s) at predefined times to hear various types of communication, such as sighs, laughter, and/or the tone(s) of a voice(s),” reads the patent. “The AI assistant may use these inputs to quantify the user’s emotional state or generate other insights about the user.”

The patent also discusses connecting audio inputs to information like when a user takes their medicine, proposing that “the AI assistant may take multiple inputs in addition to audio inputs (e.g., of a user’s voice) to provide a summary of emotional trends based on various inputs (e.g., a happier emotional state associated with a particular time of day or at a time when medication is taken, etc.)”

It’s worth noting that fellow tech giant Amazon tried and failed to market a similar system. In 2020, the company launched the Halo Band, a fitness band with a built-in microphone that was designed to listen in on users and conduct what Amazon described as a “tone of voice analysis.” Following public backlash in 2021, Amazon nuked the microphones when it launched a next-generation version of the band. It discontinued the product line altogether in 2023.

Whether we’ll ever see Meta attempt to launch a similar mood-tracking device is unclear. In a statement to 404 Media, a Meta spokesperson said that “like other companies, patents at Meta are often filed to disclose concepts that may or may not be implemented, and a granted patent does not guarantee that Meta has pursued or will pursue the technology described.”

The existence of the patent, though, shows that such a device is certainly on Meta’s mind — and is yet another Meta-made product that stands to strengthen the bridge between our online and offline worlds.

More on Meta products: The Backlash Is So Strong That People With “Pervert Glasses” Are Afraid to Use Them in Public