Smart glasses can look like a simple consumer gadget: a camera on your face, speakers in your ears, and an AI assistant that can answer questions about what you see. But the same device can give an AI system something it has always lacked: a first-person view of everyday human life.
That matters because teaching AI to write or generate images is very different from teaching a machine to move through the physical world. A robot needs to understand where objects are, what happens when they move, and how hands interact with things that bend, break, spill, or change shape.
Meta has spent years researching wearable devices that capture this kind of information. Its Ray-Ban Meta glasses put some of that technology into a consumer product, giving the company access to data generated during ordinary activities.
A 72-hour test of the glasses, using their AI features throughout the day and requesting the associated data, offered a glimpse into why first-person recordings could be valuable for training AI, and why privacy becomes harder to separate from the technology itself.
How AI learns from the real world
Large language models learn from enormous collections of written material. That works well for systems built around language, but text can’t fully describe how people might do things like move through a kitchen, pick up a bottle, crack an egg, or find their keys.
Human beings learn those things through years of sensory experience. Meta’s former chief AI scientist Yann LeCun has argued that by age four, a child has seen 50 times more data than even the largest language models. His broader point is that machines need richer sensory input if they are going to understand the physical world.
For a robot, that means learning from more than instructions. It needs data on what people actually do, including the small variations that are difficult to describe in words. So for example, someone doing the dishes may look mundane. But once that footage is labeled and annotated, it can show an AI system where objects are, how hands move, and what happens when something unexpected occurs.
That kind of training data is difficult to collect at scale. A wearable camera offers one possible solution because it can capture the world from the same perspective as the person performing the task. As LeCun’s argument puts it, “It needs eyes.”
Why Meta is using smart glasses
Meta has been working on this problem for years through Project Aria(uusi ikkuna), a research program built around wearable computers in a glasses form factor. The research devices use cameras and other sensors to study how people interact with the world.
Project Aria also shows how different the privacy expectations can be between research and consumer use. Meta’s published guidelines say research participants are trained on appropriate recording practices, people in private homes must consent, and a visible light indicates when audio and video are being collected.
Consumer smart glasses operate in a much less controlled environment. A person can wear them while walking down a street, shopping, making coffee, or doing household chores. That creates a useful source of first-person data. It also means people around the wearer may appear in recordings without knowing that a camera is active.
The distinction matters because the value of this data comes from its ordinary nature. Its value comes from capturing the small details of everyday life.
What robots need to learn
Researchers are working on several problems that look simple to humans but are difficult for machines. One is episodic memory. Asking an AI where you left your keys sounds easy, but the system has to recognize the object, understand when it was last seen, and keep track of what happened between then and now.
Another is intuitive physics. If you roll a ball toward a table, you already have an expectation about what will happen. Humans develop these predictions through years of observing the physical world.
The third involves hand-object interactions. Tying shoelaces, buttoning a shirt, picking something up, or handling a piece of cloth all require a machine to deal with objects that can bend and deform. Those are the kinds of situations that first-person recordings can capture.
During the 72-hour test, ordinary activities mapped surprisingly well onto these research problems. Driving involved predicting how objects move through space. Picking up a bottle or cracking an egg involved hand-object interaction. Watching an egg roll off a counter involved intuitive physics. Asking where the keys had been left was an episodic-memory task.
The point is not that every mundane recording immediately becomes useful training data. It is that ordinary human activity contains the examples that embodied AI needs.
What Meta’s glasses can capture
Meta says Ray-Ban Meta glasses do not continuously record everything around the wearer for AI training. According to the company, the data used to train its AI and potentially reviewed by humans includes the vocal commands and video captured when a user asks the AI to do something.
When the AI needs to analyze what the camera sees, the relevant footage can be sent to Meta’s servers for processing. The company can then use that information to improve its AI systems. A person can ask the glasses about an object, a location, a task, or something happening in front of them, creating a record of those interactions from a first-person perspective.
Meta has also introduced Live AI, which makes the assistant available without requiring the usual wake phrase. That makes the glasses more useful as a real-time assistant, while also increasing the amount of time in which their camera and microphone can be active.
There is another privacy problem that is harder to solve through settings. The wearer controls the device, but everyone around them does not. During the test, faces were blurred in the material that was reviewed, but people around the wearer did not know they were being recorded. That is different from Meta’s Project Aria research process, where participants and people in certain private environments are subject to explicit consent requirements.
What points to Meta’s robotics plans
The idea that Meta could use wearable data to help build robots is still a hypothesis about the company’s broader strategy, rather than something the glasses alone prove. There are, however, several pieces of evidence behind it.
In February 2025, Meta created a humanoid robotics division within Reality Labs, the same broader organization responsible for its smart glasses. In May 2026, Meta also acquired Assured Robot Intelligence, a robotics lab co-founded by Lerrel Pinto.
Meta has also said it wants its technology to serve as the software layer for humanoid robots. Its research has already explored how egocentric recordings can help robots learn physical tasks. That makes the glasses relevant beyond their role as an AI assistant. They put cameras, microphones, and AI into a device people can wear throughout the day.
Meta’s next-generation wearable prototypes are described as moving toward more continuous sensing and stronger object tracking. Those capabilities could produce more useful data about how people interact with the physical world.
None of this establishes that Meta is secretly collecting every moment of its customers’ lives to build an army of robots. It does show why first-person wearable data could be strategically valuable to a company investing heavily in both AI and robotics.
The bigger question
Smart glasses make AI more useful because they give it access to the world around us. That same capability makes them different from the AI assistants most people are used to. The question is who gets to decide how this increasingly personal source of data is collected, processed, and used.
As AI moves from the screen into the physical world, first-person data becomes more valuable.
That makes it increasingly important to understand what a device can see, hear, store, and send away.
