Meta is working on automatic room scanning for Quest Pro

Image: Goal

Mixed reality with Quest 2 is tedious and requires drawing rooms by hand. Future devices starting with Quest Pro might do this automatically.

Part of a believable mixed reality experience comes from the headset having a 3D understanding of the physical environment. This is the only way that digital objects can realistically interact with the physical world.

For interactions of this type, you must draw the walls manually. This is a laborious process with irregular results, depending on the room. The difficulty of this process is a major obstacle in the path of consumer adoption. At least, with mission 2.

Now Meta promises to make amends. In a blog post, the company writes that its goal is to develop an automated version of room entry that eliminates the need to manually draw rooms.

Meta Quest Pro has a better understanding of space

In the blog post, Meta introduces a new name for its own mixed reality system: goal reality. It also goes into detail about its components. These include,

• the stereoscopic step,
• a 3D spatial understanding,
• persistent site anchors, Y,
• shared room anchors for local multiplayer.

The article provides readable information on how Meta Quest Pro’s transfer mode works.

Thanks to a new sensor architecture with higher resolution cameras and RGB sensors, as well as improved computer vision algorithms, the digital reconstruction of the physical environment looks more believable than with Meta Quest 2. It even theoretically allows for 3D mapping.

“Time (oculus) Knowledge (Quest 2 Inside Out Tracking Software) uses approximately 100 points of interest in a room to pinpoint the headset’s position in space, our depth-sensing solution in Meta Quest Pro generates up to 10,000 points per frame up to five meters away under a variety of natural and artificial lighting conditions,” Meta writes.

With these point clouds, the headset creates a 3D map of the world. This helps to correctly map the physical environment in walkthrough mode. So he Quest Pro Simplified Depth Sensor it may not even be needed to scan the room, as chief technology officer Andrew Bosworth has already hinted at. However, it remains to be seen when and for which devices the feature will be rolled out.

Only the beginning of the journey of the Meta Reality

Meta also goes into detail about the other building blocks of believable mixed reality, promising that “Meta Reality” will only get better thanks to software updates and hardware advancements in future Quest products (goal mission 3?).

“Meta Quest Pro is the first of many mr devices that explore the exciting potential of this emerging technology”, says Silveira Cabral, specialist in machine vision at Meta. “We want to learn alongside developers as they create compelling experiences that redefine what’s possible with a VR headset.”

Are you interested in mixed reality? Then take a look at our article on the The 15 best mixed reality experiences for Quest 2 and Quest Pro.

Note: Links to online stores in articles may be so-called affiliate links. If you buy through this link, MIXED receives a commission from the provider. For you the price does not change.