Bounding Sphere causes object to flicker

I’m starting out with collision detection using bounding spheres. When I set the boundingSphere’s center to match the BufferGeometry I’m using, it causes the geometry to randomly flicker on screen. The collision still registers even if the geometry does not appear on screen.

This does not happen if the boundingSphere’s center is set to default (0, 0, 0). Any help is appreciated