What is the SOA of Nerfs and Gaussian Splatting renderers? nerf-casting

Discussion
1

I checked out gaussian splatting and scans to create 3d scenes. I even played around with it a bunch using lumalabs scanner app.
Will Nutter on Instagram: "Bug's Eye View - using luma ai #gaussiansplatting" Will Nutter on Instagram: "Wobbly Chair #lumalabsai #threejs #gaussiansplatting"

but it always had this problem of not being able to get reflective surfaces like windows well.

but now I see this..

It looks great. Is anyone using this for rendering scans?? how can I use it in scenes??

Not sure I can build a full renderer from scan data to incorporate this or if I need to train a model either.

Any tips thoughts or discussion is welcome.

  • Will
2

That’s old tech, now they’re using ray tracing with Gaussian Splatting.

3DGUT: Enabling Distorted Cameras and Secondary Rays in Gaussian Splatting

Not sure how this could be integrated into three.js, but it definitely looks promising.

1 Like
3

Great resource, I’ve been keeping a keen eye on this arXiv paper

1 Like