I found a solution that actually get around this problem by re-rendering the scene as a set of tiles, similar to how blender does it. There’s even a threejs example there! I hacked my way through it but eventually got it to work for my use case 
It’s called GitHub - greggman/dekapng: Make giant PNG files in the browser