3D Gaussian Splatting

Discussion
1

Does any one have a workflow for bringing a 3D gaussian splat into a threejs scene? :upside_down_face:

3 Likes
2

Not yet… I think it’s still just webGL … this is the main implementation I’ve seen:

I’ve thought of trying to port it to threejs. :slight_smile: but haven’t dug in too deeply.

4 Likes
3

that’s awsome @manthrax! There’s a lot of noise but really neat to see the radiance feild inference visualized in js! have been keeping a keen eye on model exports from libs such as… 3D Gaussian Splatting for Real-Time Radiance Field Rendering

1 Like
4

Yeaah! It’s pretty cool! I got it running locally too… but I had to scrape his models from my cache, he has URLs in his code to view those other examples like the bicycle/hilltop/garden scene… etc.

2 Likes
5

that would be awesome!

6

I’m surprised people aren’t jumping all over this! What do you think it would take to port it?

1 Like
7

Yes would be neat! Might not be so complex. Too bad the super cool webgl implementation from https://gsplat.tech/ is not open sourced cause it has been sold (to probably polycam…)

1 Like
8

I guess the easiest is to port Antimatter code yes!

3 Likes
9

There is a working implementation for three.js by Mkkellogg GitHub - mkkellogg/GaussianSplats3D: Three.js-based implementation of the 3D Gaussian splat viewer

The only issue I ran into is that depth testing doesn’t work for other added object3Ds. Maybe anyone with knowledge of this can point me in the right direction to implement this?

5 Likes
10

Its the same thing as a regular pointcloud in ThreeJS. You need to render your scene with multiple calls. In the first call you render the pointcloud and in the second call you render other objects, but you need to keep the depth buffer results from the first call.

1 Like
11

I have been playing with GitHub - mkkellogg/GaussianSplats3D: Three.js-based implementation of the 3D Gaussian splat viewer

And it works really well, the code is clean and performance is not so different than Luma Labs or Polycams implementation.

2 Likes
12

Do you by chance have an example for this in regular point clouds? I modified the repo code for main mesh to write in depth buffer, but it didn’t produce any result

13

@makman this looks like what you were looking for?

14

This is by far the best implementation I have seen. Many performance improvements.

1 Like
15

Apparently we got this now:
3D Gaussian Splatting in Three.js by @mkkellogg
Early stage as said by the author, but very promising.