Head-tracked “Window Mode.” Your front camera finds your head. The view reprojects in real time so the screen feels like a window into the 3D scene. True3D, no glasses.

All the rendering for this demo is done with our spatial-player library. You can install it on npm here. npmjs.com/package/spatial-pl… spatial-player is our framework for working with voxel and splat based 3D videos and static scenes.

It works by tracking the position of your head relative to the webcam, then re-rendering the 3D scene accordingly. This gives off the illusion that the 3D scene is really there, without specialized hardware. Video explainer coming soon on our YouTube: piped.video/@true3dlabs

Window mode is a 3D camera controller that emulates a window into the virtual world. You can imagine that your computer screen is really a portal into a 3D space. It's under a MIT license github.com/True3DLabs/Window…

We just open-sourced Window Mode Can’t wait to see what people build with it!

We just open-sourced Window Mode github.com/True3DLabs/Window… Video explainer coming soon on our YouTube: piped.video/@true3dlabs Can’t wait to see what people build with it

We also set up a subreddit where people share 3D videos they’ve created and follow along as we build in public: teddit.net/r/splats

For those asking: Frontend is spatialjs and the file format for 3D videos ".splv" is in spatialstudio. Going open source in the next few weeks; we’ll post in Discord. Our backend and models are on @modal and @googlecloud. Using Modal & GCP for over a year, both have great docs and simple APIs. Highly recommend Spatial Studio - PyPI: pypi.org/project/spatialstud…

I’ll post in our Discord when we open source the code in a few weeks. discord.gg/XzjxtxfwGX

You can try the Steamboat Willie example here: splats.com/watch/702?window_…

Paying respect: Johnny Lee’s 2007 Wii Remote head-tracking demo sparked this whole idea for many of us. Ours runs on-device with a front camera and lightweight models. piped.video/watch?v=Jd3-eiid…

I wrote more on the design goals and tradeoffs. Latency budget, pose smoothing, and when to prefer single-view depth over stereo. danielhabib.substack.com/p/a…

Try it in your browser: lab.true3d.com/targets (Works on phones and laptop webcams too.)

Why this matters: most 3D on phones collapses to a flat video. Asking viewers to drag the camera fights lean-back behavior. Window Mode adds presence without new habits.

What you feel: A sense of presence on a flat screen. The view responds like real objects do when you move, so motion parallax sells depth without glasses. Here’s a favorite: Steamboat Willie in 3D with Window Mode on.

How it works: Estimate head pose relative to the display, then render with head-coupled perspective so near objects shift more than far ones. That motion parallax sells depth even in 2D

enter the matrix

media keeps evolving, we’re nowhere near the finish line

gaussian depth after the coarse pass Vs the fine pass