3D Gaussian Splatting in a Weekend
bfeldman.me61 points by b__feldman 3 days ago
61 points by b__feldman 3 days ago
After seeing the fixed 3rd order spherical harmonics I was curious how that might be optimized. DropAnSH-GS (Feb 2026) drops out high order SH coefficients to force low frequency color into low order coefficients (3.4. Spherical Harmonics Dropout). They conclude that high order coefficients can be discarded to trade off speed/size for detail. They don’t seem to have considered encoding as sparse coefficients post training to discard all near zero coefficients.
How does 3DGS differ from a point cloud that is produced by Lidar or KinectV2?
Mainly by having view-dependent (i.e. changes with the camera angle) material reflectance (diffuse colour and specular highlight).
i.e. the colour (and possibly other surface properties) vary depending on their direction, which is (or at least can be) encoded spherically (as spherical harmonics).
The width/size of each point/splat is also not just a radius, it can be anisotropic, and have an orientation in space, so again, it can vary its size depending on orientation when rendered.
It has been mildly amusing watching the AI crowd learn about point clouds though, and use things the VFX industry was using in the early 00s (spherical harmonic encoded materials - we had light-dependent as well for relighting - points with direction and anisotropic widths, etc)...
> spherical harmonic encoded materials
This in particular has been hilarious for the exact reason you mentioned. For anybody curious, here's a paper from 2008 about this technique:
Ah, so 3DGS is a Neural method?
There is a neural method for computing 3DGS from video or a series of photographs. Rendering 3DGS uses no neural networks as far as I know.