New 3D/AR/XR announcements, just before the Apple Keynote that could change 3D forever

New 3D/AR/XR announcements, just before the Apple Keynote that could change 3D forever

The long-rumored Apple Glasses are almost here. It’s almost sure Apple will present his revolutionary device this June 5th. It could change forever how we interact with software, bringing long available HoloLens features (both in terms of 3D interface and interaction), in a more friendly device. This would make a natural transition in which Stereoscopic 3D will be present everywhere, not only in the content, also in the programs interfaces and how we interact with them.

But this week took the AWE USA 2023 exhibition, on which lots of Mixed Reality brands showcased their products and solutions. And there’s juicy news for Stereoscopic 3D fans.

First, let’s look at the brand that is doing the most to use 3D everywhere, Leia. Worth mentioning, their unbeatable real-time 2d to 3D converter still get us impressed, much better results than other AI converters that literally take several hours to produce results not even half as good as Leia algorithms.

Now, developers can benefit of the Leia’s 2d to 3D conversion on their Apps for XR Snapdragon devices. With the Leia Media SDK, most standalone VR headsets, can integrate 2d content (like video streaming) in a more attractive 3D manner, as watching 2d content in a virtual 3D environment looks unnatural. Developers can start testing this technology on the highly recommended Pico 4 headset.

Then, an even more exciting feature, the use of the Lume Pad 2/Nubia Pad 3D as a 3D monitor for your PC, just like the ProMa King Tablet does. Based on the Moonlight project, and properly named as Moonlight 3D, basically can stream existing SBS PC content and show it as it should be in the Lume Pad 2 display. This means you can play games working with Stereoscopic 3D drivers (like SuperDepth 3D), and other games and emulators with native 3D support (like Tomb Raider, Avatar, Citra Emulator, etc.).

Other Leia developments are the LeiaPix Cloud API (for converting any media to 3D), and the Lume Pad 2 HDK (support for Lume Pad extension hardware using the integrated pinouts).

Speaking of Snapdragon, they presented their Dual Render Fusion solution to convert existing content designed for 2d displays, to work rendered in 3D for AR (but 3D devices like the Nubia Pad 3D could take advantage of this, allowing to play many games in 3D). Dual Render Fusion can work on any Unity project.

NVIDIA showcased Neuralangelo, a photogrammetry software that constructs 3D models from 2d video, not anything new, but the results seem better than previous approaches.

AI just took 3D modeling to a whole new level 🤯

Introducing Neuralangelo, a new AI model by NVIDIA that reconstructs mind-blowingly detailed 3D surfaces directly from 2D videos — like photogrammetry on steroids. 🧙🏻‍♂️

Keep reading to see this crazy magic for yourself 🧵 pic.twitter.com/GKP75e5CQM

— Bilawal Sidhu (@bilawalsidhu) June 1, 2023

We will carefully follow the Apple WWDC Keynote. Let’s expect a detailed article tomorrow if that new device brings great things for Stereoscopic 3D.

---